gaspersic/triton
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[GH-PAGES] Updated website

Browse Source
This commit is contained in:
Philippe Tillet
2021-08-28 00:14:16 +00:00
parent 5e63614108
commit dc674ef7b7
17 changed files with 83 additions and 83 deletions
Download Patch File Download Diff File Expand all files Collapse all files

BIN
_downloads/662999063954282841dc90b8945f85ce/tutorials_jupyter.zip
View File

Binary file not shown.

BIN
_downloads/763344228ae6bc253ed1a6cf586aa30d/tutorials_python.zip
View File

Binary file not shown.

BIN
_images/sphx_glr_01-vector-add_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 23 KiB

After

Width:  |  Height:  |  Size: 25 KiB

BIN
_images/sphx_glr_01-vector-add_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 15 KiB

After

Width:  |  Height:  |  Size: 15 KiB

BIN
_images/sphx_glr_02-fused-softmax_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 37 KiB

After

Width:  |  Height:  |  Size: 38 KiB

BIN
_images/sphx_glr_02-fused-softmax_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 24 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 55 KiB

After

Width:  |  Height:  |  Size: 56 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 32 KiB

After

Width:  |  Height:  |  Size: 32 KiB

10
_sources/getting-started/tutorials/01-vector-add.rst.txt
View File

@@ -234,18 +234,18 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
0 4096.0 9.600000 9.600000
1 8192.0 19.200000 19.200000
2 16384.0 38.400001 38.400001
3 32768.0 63.999998 63.999998
3 32768.0 63.999998 76.800002
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
6 262144.0 341.333321 341.333321
7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016
9 2097152.0 722.823517 722.823517
9 2097152.0 722.823517 702.171410
10 4194304.0 780.190482 780.190482
11 8388608.0 812.429770 812.429770
12 16777216.0 833.084721 833.084721
13 33554432.0 843.811163 843.811163
14 67108864.0 849.278610 848.362445
13 33554432.0 843.811163 842.004273
14 67108864.0 848.362445 848.362445
15 134217728.0 851.577704 850.656574
@@ -254,7 +254,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 10.992 seconds)
**Total running time of the script:** ( 0 minutes 11.129 seconds)
.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:

16
_sources/getting-started/tutorials/02-fused-softmax.rst.txt
View File

@@ -301,16 +301,16 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
softmax-performance:
N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 585.142862 153.600004
2 512.0 630.153853 606.814814 154.566038
3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992
1 384.0 585.142862 585.142862 151.703707
2 512.0 630.153853 585.142849 154.566038
3 640.0 660.645170 640.000002 160.000000
4 768.0 702.171410 664.216187 162.754967
.. ... ... ... ...
93 12160.0 812.359066 406.179533 198.936606
93 12160.0 812.359066 405.755985 199.038365
94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 411.722274 198.854847
96 12544.0 810.925276 412.546756 199.111113
97 12672.0 811.007961 412.097543 199.167004
96 12544.0 810.925276 412.971190 199.111113
97 12672.0 809.389265 412.097543 199.264875
[98 rows x 4 columns]
@@ -328,7 +328,7 @@ In the above plot, we can see that:
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 1 minutes 12.593 seconds)
**Total running time of the script:** ( 1 minutes 12.673 seconds)
.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:

48
_sources/getting-started/tutorials/03-matrix-multiplication.rst.txt
View File

@@ -462,37 +462,37 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 256.0 2.730667 ... 3.276800 2.978909
0 256.0 2.978909 ... 3.276800 2.978909
1 384.0 7.372800 ... 8.507077 8.507077
2 512.0 14.563555 ... 15.420235 15.420235
3 640.0 22.260869 ... 24.380953 23.272727
4 768.0 32.768000 ... 34.028308 34.028308
5 896.0 39.025776 ... 40.140799 39.025776
5 896.0 37.971025 ... 39.025776 37.971025
6 1024.0 49.932191 ... 53.773130 52.428801
7 1152.0 44.566925 ... 46.656000 46.656000
8 1280.0 51.200001 ... 56.888887 56.109587
9 1408.0 64.138541 ... 64.902096 64.902096
10 1536.0 76.933564 ... 76.106321 76.106321
11 1664.0 62.929456 ... 62.061463 62.061463
12 1792.0 72.983276 ... 69.810085 69.379162
13 1920.0 69.120002 ... 69.467336 69.120002
9 1408.0 64.138541 ... 64.902096 57.387114
10 1536.0 77.778988 ... 75.296679 75.296679
11 1664.0 62.929456 ... 62.492442 62.492442
12 1792.0 72.983276 ... 69.810085 69.810085
13 1920.0 69.467336 ... 69.467336 69.467336
14 2048.0 73.584279 ... 74.898285 74.565406
15 2176.0 83.155572 ... 79.540109 79.855747
16 2304.0 68.446623 ... 73.501144 73.275679
17 2432.0 71.125224 ... 81.433227 82.147552
18 2560.0 78.019048 ... 77.283019 75.502306
19 2688.0 83.922689 ... 80.880718 84.483418
20 2816.0 81.674548 ... 79.443003 77.743683
21 2944.0 81.832567 ... 79.356738 78.854483
22 3072.0 82.540970 ... 80.544956 82.782312
23 3200.0 84.210524 ... 90.140846 88.642656
24 3328.0 83.034941 ... 87.687325 84.795401
25 3456.0 81.932484 ... 83.372870 85.133652
26 3584.0 88.152348 ... 91.750399 87.551500
27 3712.0 85.091436 ... 84.230479 82.287760
28 3840.0 84.292684 ... 87.080314 87.217666
29 3968.0 89.003603 ... 84.270676 88.167587
30 4096.0 93.531519 ... 88.827088 88.592559
15 2176.0 83.155572 ... 80.494588 77.697485
16 2304.0 68.446623 ... 73.275679 73.051599
17 2432.0 70.945618 ... 80.041209 81.433227
18 2560.0 77.649287 ... 76.560748 75.851852
19 2688.0 83.004501 ... 82.823267 81.576466
20 2816.0 84.360174 ... 78.584162 80.026067
21 2944.0 83.060049 ... 78.112900 77.385141
22 3072.0 78.534123 ... 83.638266 83.269271
23 3200.0 84.321474 ... 89.136491 86.137280
24 3328.0 82.275764 ... 85.602017 86.736504
25 3456.0 80.380430 ... 85.223646 80.945348
26 3584.0 87.296493 ... 95.047985 87.211821
27 3712.0 84.088676 ... 82.222152 82.017526
28 3840.0 80.197243 ... 84.485870 82.964740
29 3968.0 86.116179 ... 81.621363 87.222259
30 4096.0 93.206754 ... 83.313299 90.260743
[31 rows x 5 columns]
@@ -502,7 +502,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 2 minutes 2.007 seconds)
**Total running time of the script:** ( 2 minutes 11.868 seconds)
.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:

8
_sources/getting-started/tutorials/sg_execution_times.rst.txt
View File

@@ -5,12 +5,12 @@
Computation times
=================
**03:25.593** total execution time for **getting-started_tutorials** files:
**03:35.670** total execution time for **getting-started_tutorials** files:
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:02.007 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:11.868 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.593 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.673 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:10.992 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:11.129 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+

10
getting-started/tutorials/01-vector-add.html
View File

@@ -322,22 +322,22 @@ for different problem sizes.</p>
0 4096.0 9.600000 9.600000
1 8192.0 19.200000 19.200000
2 16384.0 38.400001 38.400001
3 32768.0 63.999998 63.999998
3 32768.0 63.999998 76.800002
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
6 262144.0 341.333321 341.333321
7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016
9 2097152.0 722.823517 722.823517
9 2097152.0 722.823517 702.171410
10 4194304.0 780.190482 780.190482
11 8388608.0 812.429770 812.429770
12 16777216.0 833.084721 833.084721
13 33554432.0 843.811163 843.811163
14 67108864.0 849.278610 848.362445
13 33554432.0 843.811163 842.004273
14 67108864.0 848.362445 848.362445
15 134217728.0 851.577704 850.656574
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 10.992 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 11.129 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>

16
getting-started/tutorials/02-fused-softmax.html
View File

@@ -386,16 +386,16 @@ We will then compare its performance against (1) <code class="code docutils lite
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>softmax-performance:
N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 585.142862 153.600004
2 512.0 630.153853 606.814814 154.566038
3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992
1 384.0 585.142862 585.142862 151.703707
2 512.0 630.153853 585.142849 154.566038
3 640.0 660.645170 640.000002 160.000000
4 768.0 702.171410 664.216187 162.754967
.. ... ... ... ...
93 12160.0 812.359066 406.179533 198.936606
93 12160.0 812.359066 405.755985 199.038365
94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 411.722274 198.854847
96 12544.0 810.925276 412.546756 199.111113
97 12672.0 811.007961 412.097543 199.167004
96 12544.0 810.925276 412.971190 199.111113
97 12672.0 809.389265 412.097543 199.264875
[98 rows x 4 columns]
</pre></div>
@@ -408,7 +408,7 @@ We will then compare its performance against (1) <code class="code docutils lite
Note however that the PyTorch <cite>softmax</cite> operation is more general and will works on tensors of any shape.</p></li>
</ul>
</div></blockquote>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.593 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.673 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>

48
getting-started/tutorials/03-matrix-multiplication.html
View File

@@ -566,42 +566,42 @@ torch_output=tensor([[ 1.1045, -36.9688, 31.4688, ..., -11.3906, 24.4531, -3
<p class="sphx-glr-script-out">Out:</p>
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 256.0 2.730667 ... 3.276800 2.978909
0 256.0 2.978909 ... 3.276800 2.978909
1 384.0 7.372800 ... 8.507077 8.507077
2 512.0 14.563555 ... 15.420235 15.420235
3 640.0 22.260869 ... 24.380953 23.272727
4 768.0 32.768000 ... 34.028308 34.028308
5 896.0 39.025776 ... 40.140799 39.025776
5 896.0 37.971025 ... 39.025776 37.971025
6 1024.0 49.932191 ... 53.773130 52.428801
7 1152.0 44.566925 ... 46.656000 46.656000
8 1280.0 51.200001 ... 56.888887 56.109587
9 1408.0 64.138541 ... 64.902096 64.902096
10 1536.0 76.933564 ... 76.106321 76.106321
11 1664.0 62.929456 ... 62.061463 62.061463
12 1792.0 72.983276 ... 69.810085 69.379162
13 1920.0 69.120002 ... 69.467336 69.120002
9 1408.0 64.138541 ... 64.902096 57.387114
10 1536.0 77.778988 ... 75.296679 75.296679
11 1664.0 62.929456 ... 62.492442 62.492442
12 1792.0 72.983276 ... 69.810085 69.810085
13 1920.0 69.467336 ... 69.467336 69.467336
14 2048.0 73.584279 ... 74.898285 74.565406
15 2176.0 83.155572 ... 79.540109 79.855747
16 2304.0 68.446623 ... 73.501144 73.275679
17 2432.0 71.125224 ... 81.433227 82.147552
18 2560.0 78.019048 ... 77.283019 75.502306
19 2688.0 83.922689 ... 80.880718 84.483418
20 2816.0 81.674548 ... 79.443003 77.743683
21 2944.0 81.832567 ... 79.356738 78.854483
22 3072.0 82.540970 ... 80.544956 82.782312
23 3200.0 84.210524 ... 90.140846 88.642656
24 3328.0 83.034941 ... 87.687325 84.795401
25 3456.0 81.932484 ... 83.372870 85.133652
26 3584.0 88.152348 ... 91.750399 87.551500
27 3712.0 85.091436 ... 84.230479 82.287760
28 3840.0 84.292684 ... 87.080314 87.217666
29 3968.0 89.003603 ... 84.270676 88.167587
30 4096.0 93.531519 ... 88.827088 88.592559
15 2176.0 83.155572 ... 80.494588 77.697485
16 2304.0 68.446623 ... 73.275679 73.051599
17 2432.0 70.945618 ... 80.041209 81.433227
18 2560.0 77.649287 ... 76.560748 75.851852
19 2688.0 83.004501 ... 82.823267 81.576466
20 2816.0 84.360174 ... 78.584162 80.026067
21 2944.0 83.060049 ... 78.112900 77.385141
22 3072.0 78.534123 ... 83.638266 83.269271
23 3200.0 84.321474 ... 89.136491 86.137280
24 3328.0 82.275764 ... 85.602017 86.736504
25 3456.0 80.380430 ... 85.223646 80.945348
26 3584.0 87.296493 ... 95.047985 87.211821
27 3712.0 84.088676 ... 82.222152 82.017526
28 3840.0 80.197243 ... 84.485870 82.964740
29 3968.0 86.116179 ... 81.621363 87.222259
30 4096.0 93.206754 ... 83.313299 90.260743
[31 rows x 5 columns]
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 2.007 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 11.868 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>

8
getting-started/tutorials/sg_execution_times.html
View File

@@ -174,7 +174,7 @@
<div class="section" id="computation-times">
<span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1>
<p><strong>03:25.593</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<p><strong>03:35.670</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<table class="docutils align-default">
<colgroup>
<col style="width: 85%" />
@@ -183,15 +183,15 @@
</colgroup>
<tbody>
<tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
<td><p>02:02.007</p></td>
<td><p>02:11.868</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
<td><p>01:12.593</p></td>
<td><p>01:12.673</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-odd"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
<td><p>00:10.992</p></td>
<td><p>00:11.129</p></td>
<td><p>0.0 MB</p></td>
</tr>
</tbody>

2
searchindex.js
View File

File diff suppressed because one or more lines are too long