gaspersic/triton
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[GH-PAGES] Updated website

Browse Source
This commit is contained in:
Philippe Tillet
2021-09-05 22:34:07 +00:00
parent 40a2ed1638
commit 0eb7e7d9da
19 changed files with 85 additions and 85 deletions
Download Patch File Download Diff File Expand all files Collapse all files

BIN
_downloads/662999063954282841dc90b8945f85ce/tutorials_jupyter.zip
View File

Binary file not shown.

BIN
_downloads/763344228ae6bc253ed1a6cf586aa30d/tutorials_python.zip
View File

Binary file not shown.

BIN
_images/sphx_glr_01-vector-add_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 25 KiB

After

Width:  |  Height:  |  Size: 25 KiB

BIN
_images/sphx_glr_01-vector-add_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 16 KiB

After

Width:  |  Height:  |  Size: 16 KiB

BIN
_images/sphx_glr_02-fused-softmax_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 37 KiB

After

Width:  |  Height:  |  Size: 37 KiB

BIN
_images/sphx_glr_02-fused-softmax_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 24 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 56 KiB

After

Width:  |  Height:  |  Size: 56 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 32 KiB

After

Width:  |  Height:  |  Size: 32 KiB

6
_sources/getting-started/tutorials/01-vector-add.rst.txt
View File

@@ -240,12 +240,12 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
6 262144.0 341.333321 384.000001
7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016
9 2097152.0 702.171410 722.823517
9 2097152.0 722.823517 722.823517
10 4194304.0 780.190482 780.190482
11 8388608.0 812.429770 812.429770
12 16777216.0 833.084721 833.084721
13 33554432.0 843.811163 843.811163
14 67108864.0 849.278610 848.362445
14 67108864.0 848.362445 848.362445
15 134217728.0 851.577704 850.656574
@@ -254,7 +254,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 10.972 seconds)
**Total running time of the script:** ( 1 minutes 9.393 seconds)
.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:

10
_sources/getting-started/tutorials/02-fused-softmax.rst.txt
View File

@@ -303,14 +303,14 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 585.142862 153.600004
2 512.0 630.153853 606.814814 154.566038
3 640.0 660.645170 640.000002 160.000000
3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ...
93 12160.0 812.359066 405.755985 199.038365
94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 412.149375 198.954424
96 12544.0 810.925276 412.971190 199.209928
97 12672.0 811.007961 412.097543 199.264875
95 12416.0 810.840807 412.149375 198.854847
96 12544.0 810.925276 412.971190 199.111113
97 12672.0 811.007961 412.516771 199.264875
[98 rows x 4 columns]
@@ -328,7 +328,7 @@ In the above plot, we can see that:
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 1 minutes 12.586 seconds)
**Total running time of the script:** ( 1 minutes 14.917 seconds)
.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:

56
_sources/getting-started/tutorials/03-matrix-multiplication.rst.txt
View File

@@ -462,37 +462,37 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 256.0 2.978909 ... 3.276800 3.276800
1 384.0 7.372800 ... 8.507077 8.507077
0 256.0 2.978909 ... 2.978909 2.978909
1 384.0 7.372800 ... 8.507077 7.899428
2 512.0 14.563555 ... 16.384000 16.384000
3 640.0 22.260869 ... 24.380953 24.380953
4 768.0 32.768000 ... 35.389441 34.028308
4 768.0 32.768000 ... 34.028308 34.028308
5 896.0 39.025776 ... 40.140799 39.025776
6 1024.0 49.932191 ... 52.428801 52.428801
7 1152.0 44.566925 ... 46.656000 46.656000
8 1280.0 51.200001 ... 56.888887 56.888887
9 1408.0 64.138541 ... 63.392744 57.368243
10 1536.0 79.526831 ... 75.296679 75.296679
11 1664.0 62.929456 ... 61.217089 61.636381
12 1792.0 72.983276 ... 62.441243 62.441243
13 1920.0 68.776119 ... 70.172588 69.818184
14 2048.0 73.584279 ... 74.565406 74.565406
15 2176.0 83.155572 ... 80.494588 80.494588
16 2304.0 68.251065 ... 73.275679 73.275679
17 2432.0 71.125224 ... 70.766913 80.041209
18 2560.0 77.649287 ... 76.740048 76.027843
19 2688.0 83.922689 ... 80.880718 83.186525
20 2816.0 83.552120 ... 78.868366 78.442822
21 2944.0 82.102191 ... 77.385141 77.990663
22 3072.0 79.415291 ... 81.238312 83.146995
23 3200.0 84.321474 ... 89.012517 89.761569
24 3328.0 83.226931 ... 85.500351 87.051143
25 3456.0 78.655188 ... 80.300370 83.632331
26 3584.0 85.879071 ... 91.470385 93.661869
27 3712.0 85.822459 ... 84.802499 88.876645
28 3840.0 85.136259 ... 87.424508 88.121115
29 3968.0 92.864488 ... 87.284643 87.597943
30 4096.0 93.466385 ... 90.504200 89.898012
7 1152.0 44.566925 ... 46.656000 45.938215
8 1280.0 51.200001 ... 56.888887 56.109587
9 1408.0 64.138541 ... 63.392744 62.664092
10 1536.0 80.430545 ... 76.106321 76.106321
11 1664.0 63.372618 ... 62.061463 62.061463
12 1792.0 72.983276 ... 62.790080 62.441243
13 1920.0 69.467336 ... 67.434145 70.172588
14 2048.0 73.908442 ... 74.565406 74.565406
15 2176.0 81.143743 ... 80.494588 80.817862
16 2304.0 68.056616 ... 73.728002 73.501144
17 2432.0 71.305746 ... 80.499895 80.269900
18 2560.0 78.019048 ... 77.465723 77.283019
19 2688.0 83.004501 ... 83.737433 84.483418
20 2816.0 81.521884 ... 78.301990 80.767055
21 2944.0 82.102191 ... 77.626218 71.194334
22 3072.0 82.540970 ... 83.025078 83.269271
23 3200.0 84.656085 ... 90.651555 84.993363
24 3328.0 83.130825 ... 86.528001 87.262177
25 3456.0 79.430113 ... 80.460651 83.459178
26 3584.0 87.466332 ... 91.938029 88.761490
27 3712.0 85.091436 ... 83.666116 83.247783
28 3840.0 81.019778 ... 79.965290 82.778440
29 3968.0 85.992909 ... 84.974886 87.535103
30 4096.0 93.531519 ... 90.200084 89.837839
[31 rows x 5 columns]
@@ -502,7 +502,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 2 minutes 20.017 seconds)
**Total running time of the script:** ( 2 minutes 19.244 seconds)
.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:

2
_sources/getting-started/tutorials/04-low-memory-dropout.rst.txt
View File

@@ -238,7 +238,7 @@ References
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 0.316 seconds)
**Total running time of the script:** ( 0 minutes 0.306 seconds)
.. _sphx_glr_download_getting-started_tutorials_04-low-memory-dropout.py:

10
_sources/getting-started/tutorials/sg_execution_times.rst.txt
View File

@@ -5,14 +5,14 @@
Computation times
=================
**03:43.892** total execution time for **getting-started_tutorials** files:
**04:43.861** total execution time for **getting-started_tutorials** files:
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:20.017 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:19.244 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.586 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:14.917 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:10.972 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 01:09.393 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py` (``04-low-memory-dropout.py``) | 00:00.316 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py` (``04-low-memory-dropout.py``) | 00:00.306 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+

6
getting-started/tutorials/01-vector-add.html
View File

@@ -329,16 +329,16 @@ for different problem sizes.</p>
6 262144.0 341.333321 384.000001
7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016
9 2097152.0 702.171410 722.823517
9 2097152.0 722.823517 722.823517
10 4194304.0 780.190482 780.190482
11 8388608.0 812.429770 812.429770
12 16777216.0 833.084721 833.084721
13 33554432.0 843.811163 843.811163
14 67108864.0 849.278610 848.362445
14 67108864.0 848.362445 848.362445
15 134217728.0 851.577704 850.656574
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 10.972 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 9.393 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>

10
getting-started/tutorials/02-fused-softmax.html
View File

@@ -389,14 +389,14 @@ We will then compare its performance against (1) <code class="code docutils lite
0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 585.142862 153.600004
2 512.0 630.153853 606.814814 154.566038
3 640.0 660.645170 640.000002 160.000000
3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ...
93 12160.0 812.359066 405.755985 199.038365
94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 412.149375 198.954424
96 12544.0 810.925276 412.971190 199.209928
97 12672.0 811.007961 412.097543 199.264875
95 12416.0 810.840807 412.149375 198.854847
96 12544.0 810.925276 412.971190 199.111113
97 12672.0 811.007961 412.516771 199.264875
[98 rows x 4 columns]
</pre></div>
@@ -409,7 +409,7 @@ We will then compare its performance against (1) <code class="code docutils lite
Note however that the PyTorch <cite>softmax</cite> operation is more general and will works on tensors of any shape.</p></li>
</ul>
</div></blockquote>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.586 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 14.917 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>

56
getting-started/tutorials/03-matrix-multiplication.html
View File

@@ -567,42 +567,42 @@ torch_output=tensor([[ 1.1045, -36.9688, 31.4688, ..., -11.3906, 24.4531, -3
<p class="sphx-glr-script-out">Out:</p>
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 256.0 2.978909 ... 3.276800 3.276800
1 384.0 7.372800 ... 8.507077 8.507077
0 256.0 2.978909 ... 2.978909 2.978909
1 384.0 7.372800 ... 8.507077 7.899428
2 512.0 14.563555 ... 16.384000 16.384000
3 640.0 22.260869 ... 24.380953 24.380953
4 768.0 32.768000 ... 35.389441 34.028308
4 768.0 32.768000 ... 34.028308 34.028308
5 896.0 39.025776 ... 40.140799 39.025776
6 1024.0 49.932191 ... 52.428801 52.428801
7 1152.0 44.566925 ... 46.656000 46.656000
8 1280.0 51.200001 ... 56.888887 56.888887
9 1408.0 64.138541 ... 63.392744 57.368243
10 1536.0 79.526831 ... 75.296679 75.296679
11 1664.0 62.929456 ... 61.217089 61.636381
12 1792.0 72.983276 ... 62.441243 62.441243
13 1920.0 68.776119 ... 70.172588 69.818184
14 2048.0 73.584279 ... 74.565406 74.565406
15 2176.0 83.155572 ... 80.494588 80.494588
16 2304.0 68.251065 ... 73.275679 73.275679
17 2432.0 71.125224 ... 70.766913 80.041209
18 2560.0 77.649287 ... 76.740048 76.027843
19 2688.0 83.922689 ... 80.880718 83.186525
20 2816.0 83.552120 ... 78.868366 78.442822
21 2944.0 82.102191 ... 77.385141 77.990663
22 3072.0 79.415291 ... 81.238312 83.146995
23 3200.0 84.321474 ... 89.012517 89.761569
24 3328.0 83.226931 ... 85.500351 87.051143
25 3456.0 78.655188 ... 80.300370 83.632331
26 3584.0 85.879071 ... 91.470385 93.661869
27 3712.0 85.822459 ... 84.802499 88.876645
28 3840.0 85.136259 ... 87.424508 88.121115
29 3968.0 92.864488 ... 87.284643 87.597943
30 4096.0 93.466385 ... 90.504200 89.898012
7 1152.0 44.566925 ... 46.656000 45.938215
8 1280.0 51.200001 ... 56.888887 56.109587
9 1408.0 64.138541 ... 63.392744 62.664092
10 1536.0 80.430545 ... 76.106321 76.106321
11 1664.0 63.372618 ... 62.061463 62.061463
12 1792.0 72.983276 ... 62.790080 62.441243
13 1920.0 69.467336 ... 67.434145 70.172588
14 2048.0 73.908442 ... 74.565406 74.565406
15 2176.0 81.143743 ... 80.494588 80.817862
16 2304.0 68.056616 ... 73.728002 73.501144
17 2432.0 71.305746 ... 80.499895 80.269900
18 2560.0 78.019048 ... 77.465723 77.283019
19 2688.0 83.004501 ... 83.737433 84.483418
20 2816.0 81.521884 ... 78.301990 80.767055
21 2944.0 82.102191 ... 77.626218 71.194334
22 3072.0 82.540970 ... 83.025078 83.269271
23 3200.0 84.656085 ... 90.651555 84.993363
24 3328.0 83.130825 ... 86.528001 87.262177
25 3456.0 79.430113 ... 80.460651 83.459178
26 3584.0 87.466332 ... 91.938029 88.761490
27 3712.0 85.091436 ... 83.666116 83.247783
28 3840.0 81.019778 ... 79.965290 82.778440
29 3968.0 85.992909 ... 84.974886 87.535103
30 4096.0 93.531519 ... 90.200084 89.837839
[31 rows x 5 columns]
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 20.017 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 19.244 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>

2
getting-started/tutorials/04-low-memory-dropout.html
View File

@@ -370,7 +370,7 @@ to explore the <cite>triton/language/random</cite> folder!</p>
<dd><p>Nitish Srivastava and Geoffrey Hinton and Alex Krizhevsky and Ilya Sutskever and Ruslan Salakhutdinov, “Dropout: A Simple Way to Prevent Neural Networks from Overfitting”, JMLR 2014</p>
</dd>
</dl>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 0.316 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 0.306 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-04-low-memory-dropout-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/c9aed78977a4c05741d675a38dde3d7d/04-low-memory-dropout.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">04-low-memory-dropout.py</span></code></a></p>

10
getting-started/tutorials/sg_execution_times.html
View File

@@ -174,7 +174,7 @@
<div class="section" id="computation-times">
<span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1>
<p><strong>03:43.892</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<p><strong>04:43.861</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<table class="docutils align-default">
<colgroup>
<col style="width: 85%" />
@@ -183,19 +183,19 @@
</colgroup>
<tbody>
<tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
<td><p>02:20.017</p></td>
<td><p>02:19.244</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
<td><p>01:12.586</p></td>
<td><p>01:14.917</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-odd"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
<td><p>00:10.972</p></td>
<td><p>01:09.393</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-even"><td><p><a class="reference internal" href="04-low-memory-dropout.html#sphx-glr-getting-started-tutorials-04-low-memory-dropout-py"><span class="std std-ref">Low-Memory Dropout</span></a> (<code class="docutils literal notranslate"><span class="pre">04-low-memory-dropout.py</span></code>)</p></td>
<td><p>00:00.316</p></td>
<td><p>00:00.306</p></td>
<td><p>0.0 MB</p></td>
</tr>
</tbody>

2
searchindex.js
View File

File diff suppressed because one or more lines are too long