gaspersic/triton
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[GH-PAGES] Updated website

Browse Source
This commit is contained in:
Philippe Tillet
2021-09-08 00:12:59 +00:00
parent 1bfcc182af
commit 8de0624b97
19 changed files with 81 additions and 81 deletions
Download Patch File Download Diff File Expand all files Collapse all files

BIN
_downloads/662999063954282841dc90b8945f85ce/tutorials_jupyter.zip
View File

Binary file not shown.

BIN
_downloads/763344228ae6bc253ed1a6cf586aa30d/tutorials_python.zip
View File

Binary file not shown.

BIN
_images/sphx_glr_01-vector-add_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 24 KiB

BIN
_images/sphx_glr_01-vector-add_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 15 KiB

After

Width:  |  Height:  |  Size: 15 KiB

BIN
_images/sphx_glr_02-fused-softmax_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 37 KiB

After

Width:  |  Height:  |  Size: 38 KiB

BIN
_images/sphx_glr_02-fused-softmax_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 24 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 55 KiB

After

Width:  |  Height:  |  Size: 57 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 32 KiB

After

Width:  |  Height:  |  Size: 32 KiB

6
_sources/getting-started/tutorials/01-vector-add.rst.txt
View File

@@ -231,7 +231,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
vector-add-performance:
size Triton Torch
0 4096.0 9.540372 9.600000
0 4096.0 9.600000 9.600000
1 8192.0 19.200000 19.200000
2 16384.0 38.400001 38.400001
3 32768.0 76.800002 76.800002
@@ -246,7 +246,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
12 16777216.0 833.084721 833.084721
13 33554432.0 843.811163 843.811163
14 67108864.0 848.362445 848.362445
15 134217728.0 851.116890 850.656574
15 134217728.0 851.577704 850.656574
@@ -254,7 +254,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 10.964 seconds)
**Total running time of the script:** ( 0 minutes 11.019 seconds)
.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:

12
_sources/getting-started/tutorials/02-fused-softmax.rst.txt
View File

@@ -306,11 +306,11 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ...
93 12160.0 812.359066 405.755985 199.038365
94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 412.149375 198.755369
96 12544.0 810.925276 412.971190 199.111113
97 12672.0 811.007961 412.097543 199.167004
93 12160.0 812.359066 406.179533 198.733401
94 12288.0 812.429770 416.101597 199.096718
95 12416.0 810.840807 412.149375 198.655991
96 12544.0 810.925276 412.546756 198.913776
97 12672.0 811.007961 412.097543 198.873965
[98 rows x 4 columns]
@@ -328,7 +328,7 @@ In the above plot, we can see that:
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 1 minutes 12.596 seconds)
**Total running time of the script:** ( 1 minutes 12.589 seconds)
.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:

50
_sources/getting-started/tutorials/03-matrix-multiplication.rst.txt
View File

@@ -462,37 +462,37 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 256.0 2.978909 ... 3.276800 2.978909
1 384.0 7.372800 ... 7.899428 7.899428
2 512.0 14.563555 ... 16.384000 15.420235
0 256.0 2.978909 ... 2.978909 2.978909
1 384.0 7.372800 ... 8.507077 8.507077
2 512.0 14.563555 ... 16.384000 16.384000
3 640.0 22.260869 ... 24.380953 24.380953
4 768.0 32.768000 ... 34.028308 34.028308
5 896.0 37.971025 ... 39.025776 39.025776
5 896.0 39.025776 ... 39.025776 35.994954
6 1024.0 49.932191 ... 52.428801 52.428801
7 1152.0 44.566925 ... 46.656000 46.656000
8 1280.0 51.200001 ... 56.888887 56.888887
9 1408.0 64.138541 ... 63.392744 62.664092
10 1536.0 79.526831 ... 75.296679 76.106321
11 1664.0 62.929456 ... 62.061463 62.061463
10 1536.0 80.430545 ... 76.933564 75.296679
11 1664.0 63.372618 ... 62.061463 62.061463
12 1792.0 72.983276 ... 62.441243 62.441243
13 1920.0 69.120002 ... 68.776119 68.776119
14 2048.0 73.584279 ... 74.235468 74.565406
15 2176.0 83.155572 ... 80.173899 81.143743
16 2304.0 68.056616 ... 73.275679 73.275679
17 2432.0 71.125224 ... 72.037087 82.630777
18 2560.0 78.019048 ... 76.560748 76.027843
19 2688.0 84.108772 ... 81.752274 81.401408
20 2816.0 83.552120 ... 78.726003 79.298560
21 2944.0 80.510553 ... 78.112900 75.853930
22 3072.0 81.825298 ... 83.146995 81.589488
23 3200.0 84.768213 ... 86.253369 90.014065
24 3328.0 83.226931 ... 81.622783 86.632127
25 3456.0 81.600781 ... 83.980802 84.068369
26 3584.0 87.211821 ... 85.797134 85.308722
27 3712.0 85.822459 ... 79.472826 78.721311
28 3840.0 83.465663 ... 86.197974 86.265212
29 3968.0 93.219206 ... 86.849777 87.222259
30 4096.0 93.206754 ... 89.958266 89.777746
13 1920.0 69.120002 ... 70.530615 70.172588
14 2048.0 73.908442 ... 74.898285 74.565406
15 2176.0 83.500614 ... 81.143743 78.916269
16 2304.0 68.056616 ... 73.501144 72.828879
17 2432.0 71.125224 ... 82.388456 81.433227
18 2560.0 77.833728 ... 77.283019 75.851852
19 2688.0 81.752274 ... 83.369354 80.708630
20 2816.0 83.392363 ... 79.587973 78.584162
21 2944.0 79.865439 ... 78.605729 77.747321
22 3072.0 80.890151 ... 83.638266 83.025078
23 3200.0 81.528664 ... 90.140846 86.603520
24 3328.0 83.034941 ... 87.262177 82.558825
25 3456.0 79.273916 ... 80.460651 79.040756
26 3584.0 87.466332 ... 93.080114 85.876512
27 3712.0 85.091436 ... 82.698613 81.950243
28 3840.0 81.019778 ... 86.063813 86.197974
29 3968.0 93.219206 ... 87.850207 86.973584
30 4096.0 93.727466 ... 84.894196 90.018600
[31 rows x 5 columns]
@@ -502,7 +502,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 2 minutes 5.162 seconds)
**Total running time of the script:** ( 1 minutes 59.549 seconds)
.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:

2
_sources/getting-started/tutorials/04-low-memory-dropout.rst.txt
View File

@@ -238,7 +238,7 @@ References
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 0.187 seconds)
**Total running time of the script:** ( 0 minutes 0.185 seconds)
.. _sphx_glr_download_getting-started_tutorials_04-low-memory-dropout.py:

10
_sources/getting-started/tutorials/sg_execution_times.rst.txt
View File

@@ -5,14 +5,14 @@
Computation times
=================
**03:28.909** total execution time for **getting-started_tutorials** files:
**03:23.342** total execution time for **getting-started_tutorials** files:
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:05.162 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 01:59.549 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.596 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.589 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:10.964 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:11.019 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py` (``04-low-memory-dropout.py``) | 00:00.187 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py` (``04-low-memory-dropout.py``) | 00:00.185 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+

6
getting-started/tutorials/01-vector-add.html
View File

@@ -320,7 +320,7 @@ for different problem sizes.</p>
<p class="sphx-glr-script-out">Out:</p>
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>vector-add-performance:
size Triton Torch
0 4096.0 9.540372 9.600000
0 4096.0 9.600000 9.600000
1 8192.0 19.200000 19.200000
2 16384.0 38.400001 38.400001
3 32768.0 76.800002 76.800002
@@ -335,10 +335,10 @@ for different problem sizes.</p>
12 16777216.0 833.084721 833.084721
13 33554432.0 843.811163 843.811163
14 67108864.0 848.362445 848.362445
15 134217728.0 851.116890 850.656574
15 134217728.0 851.577704 850.656574
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 10.964 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 11.019 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>

12
getting-started/tutorials/02-fused-softmax.html
View File

@@ -392,11 +392,11 @@ We will then compare its performance against (1) <code class="code docutils lite
3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ...
93 12160.0 812.359066 405.755985 199.038365
94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 412.149375 198.755369
96 12544.0 810.925276 412.971190 199.111113
97 12672.0 811.007961 412.097543 199.167004
93 12160.0 812.359066 406.179533 198.733401
94 12288.0 812.429770 416.101597 199.096718
95 12416.0 810.840807 412.149375 198.655991
96 12544.0 810.925276 412.546756 198.913776
97 12672.0 811.007961 412.097543 198.873965
[98 rows x 4 columns]
</pre></div>
@@ -409,7 +409,7 @@ We will then compare its performance against (1) <code class="code docutils lite
Note however that the PyTorch <cite>softmax</cite> operation is more general and will works on tensors of any shape.</p></li>
</ul>
</div></blockquote>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.596 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.589 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>

50
getting-started/tutorials/03-matrix-multiplication.html
View File

@@ -567,42 +567,42 @@ torch_output=tensor([[ 1.1045, -36.9688, 31.4688, ..., -11.3906, 24.4531, -3
<p class="sphx-glr-script-out">Out:</p>
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 256.0 2.978909 ... 3.276800 2.978909
1 384.0 7.372800 ... 7.899428 7.899428
2 512.0 14.563555 ... 16.384000 15.420235
0 256.0 2.978909 ... 2.978909 2.978909
1 384.0 7.372800 ... 8.507077 8.507077
2 512.0 14.563555 ... 16.384000 16.384000
3 640.0 22.260869 ... 24.380953 24.380953
4 768.0 32.768000 ... 34.028308 34.028308
5 896.0 37.971025 ... 39.025776 39.025776
5 896.0 39.025776 ... 39.025776 35.994954
6 1024.0 49.932191 ... 52.428801 52.428801
7 1152.0 44.566925 ... 46.656000 46.656000
8 1280.0 51.200001 ... 56.888887 56.888887
9 1408.0 64.138541 ... 63.392744 62.664092
10 1536.0 79.526831 ... 75.296679 76.106321
11 1664.0 62.929456 ... 62.061463 62.061463
10 1536.0 80.430545 ... 76.933564 75.296679
11 1664.0 63.372618 ... 62.061463 62.061463
12 1792.0 72.983276 ... 62.441243 62.441243
13 1920.0 69.120002 ... 68.776119 68.776119
14 2048.0 73.584279 ... 74.235468 74.565406
15 2176.0 83.155572 ... 80.173899 81.143743
16 2304.0 68.056616 ... 73.275679 73.275679
17 2432.0 71.125224 ... 72.037087 82.630777
18 2560.0 78.019048 ... 76.560748 76.027843
19 2688.0 84.108772 ... 81.752274 81.401408
20 2816.0 83.552120 ... 78.726003 79.298560
21 2944.0 80.510553 ... 78.112900 75.853930
22 3072.0 81.825298 ... 83.146995 81.589488
23 3200.0 84.768213 ... 86.253369 90.014065
24 3328.0 83.226931 ... 81.622783 86.632127
25 3456.0 81.600781 ... 83.980802 84.068369
26 3584.0 87.211821 ... 85.797134 85.308722
27 3712.0 85.822459 ... 79.472826 78.721311
28 3840.0 83.465663 ... 86.197974 86.265212
29 3968.0 93.219206 ... 86.849777 87.222259
30 4096.0 93.206754 ... 89.958266 89.777746
13 1920.0 69.120002 ... 70.530615 70.172588
14 2048.0 73.908442 ... 74.898285 74.565406
15 2176.0 83.500614 ... 81.143743 78.916269
16 2304.0 68.056616 ... 73.501144 72.828879
17 2432.0 71.125224 ... 82.388456 81.433227
18 2560.0 77.833728 ... 77.283019 75.851852
19 2688.0 81.752274 ... 83.369354 80.708630
20 2816.0 83.392363 ... 79.587973 78.584162
21 2944.0 79.865439 ... 78.605729 77.747321
22 3072.0 80.890151 ... 83.638266 83.025078
23 3200.0 81.528664 ... 90.140846 86.603520
24 3328.0 83.034941 ... 87.262177 82.558825
25 3456.0 79.273916 ... 80.460651 79.040756
26 3584.0 87.466332 ... 93.080114 85.876512
27 3712.0 85.091436 ... 82.698613 81.950243
28 3840.0 81.019778 ... 86.063813 86.197974
29 3968.0 93.219206 ... 87.850207 86.973584
30 4096.0 93.727466 ... 84.894196 90.018600
[31 rows x 5 columns]
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 5.162 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 59.549 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>

2
getting-started/tutorials/04-low-memory-dropout.html
View File

@@ -370,7 +370,7 @@ to explore the <cite>triton/language/random</cite> folder!</p>
<dd><p>Nitish Srivastava and Geoffrey Hinton and Alex Krizhevsky and Ilya Sutskever and Ruslan Salakhutdinov, “Dropout: A Simple Way to Prevent Neural Networks from Overfitting”, JMLR 2014</p>
</dd>
</dl>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 0.187 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 0.185 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-04-low-memory-dropout-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/c9aed78977a4c05741d675a38dde3d7d/04-low-memory-dropout.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">04-low-memory-dropout.py</span></code></a></p>

10
getting-started/tutorials/sg_execution_times.html
View File

@@ -174,7 +174,7 @@
<div class="section" id="computation-times">
<span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1>
<p><strong>03:28.909</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<p><strong>03:23.342</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<table class="docutils align-default">
<colgroup>
<col style="width: 85%" />
@@ -183,19 +183,19 @@
</colgroup>
<tbody>
<tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
<td><p>02:05.162</p></td>
<td><p>01:59.549</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
<td><p>01:12.596</p></td>
<td><p>01:12.589</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-odd"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
<td><p>00:10.964</p></td>
<td><p>00:11.019</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-even"><td><p><a class="reference internal" href="04-low-memory-dropout.html#sphx-glr-getting-started-tutorials-04-low-memory-dropout-py"><span class="std std-ref">Low-Memory Dropout</span></a> (<code class="docutils literal notranslate"><span class="pre">04-low-memory-dropout.py</span></code>)</p></td>
<td><p>00:00.187</p></td>
<td><p>00:00.185</p></td>
<td><p>0.0 MB</p></td>
</tr>
</tbody>

2
searchindex.js
View File

File diff suppressed because one or more lines are too long