gaspersic/triton
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[GH-PAGES] Updated website

Browse Source
This commit is contained in:
Philippe Tillet
2021-08-10 00:13:46 +00:00
parent 7a3b60cc85
commit 0875eac4b7
17 changed files with 85 additions and 85 deletions
Download Patch File Download Diff File Expand all files Collapse all files

BIN
_downloads/662999063954282841dc90b8945f85ce/tutorials_jupyter.zip
View File

Binary file not shown.

BIN
_downloads/763344228ae6bc253ed1a6cf586aa30d/tutorials_python.zip
View File

Binary file not shown.

BIN
_images/sphx_glr_01-vector-add_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 24 KiB

BIN
_images/sphx_glr_01-vector-add_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 15 KiB

After

Width:  |  Height:  |  Size: 15 KiB

BIN
_images/sphx_glr_02-fused-softmax_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 37 KiB

After

Width:  |  Height:  |  Size: 37 KiB

BIN
_images/sphx_glr_02-fused-softmax_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 24 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 54 KiB

After

Width:  |  Height:  |  Size: 54 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 31 KiB

After

Width:  |  Height:  |  Size: 32 KiB

4
_sources/getting-started/tutorials/01-vector-add.rst.txt
View File

@@ -237,7 +237,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
3 32768.0 76.800002 76.800002
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
6 262144.0 341.333321 341.333321
6 262144.0 341.333321 384.000001
7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016
9 2097152.0 722.823517 722.823517
@@ -254,7 +254,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 11.022 seconds)
**Total running time of the script:** ( 0 minutes 11.027 seconds)
.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:

16
_sources/getting-started/tutorials/02-fused-softmax.rst.txt
View File

@@ -301,16 +301,16 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
softmax-performance:
N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 585.142862 151.703707
1 384.0 585.142862 585.142862 153.600004
2 512.0 630.153853 606.814814 154.566038
3 640.0 660.645170 640.000002 160.000000
3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ...
93 12160.0 812.359066 405.755985 199.038365
94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 411.722274 198.954424
96 12544.0 809.290334 412.971190 199.209928
97 12672.0 811.007961 412.097543 199.264875
93 12160.0 812.359066 406.179533 198.936606
94 12288.0 812.429770 415.661740 199.197579
95 12416.0 810.840807 412.149375 198.854847
96 12544.0 809.290334 412.546756 199.111113
97 12672.0 811.007961 412.097543 199.167004
[98 rows x 4 columns]
@@ -329,7 +329,7 @@ In the above plot, we can see that:
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 1 minutes 12.632 seconds)
**Total running time of the script:** ( 1 minutes 12.611 seconds)
.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:

56
_sources/getting-started/tutorials/03-matrix-multiplication.rst.txt
View File

@@ -471,37 +471,37 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 128.0 0.455111 ... 0.512000 0.512000
1 256.0 2.730667 ... 3.276800 2.978909
2 384.0 7.372800 ... 8.507077 8.507077
3 512.0 14.563555 ... 16.384000 16.384000
4 640.0 22.260869 ... 24.380953 24.380953
1 256.0 2.978909 ... 2.978909 2.978909
2 384.0 7.372800 ... 8.507077 7.899428
3 512.0 14.563555 ... 16.384000 15.420235
4 640.0 22.260869 ... 23.272727 23.272727
5 768.0 32.768000 ... 34.028308 34.028308
6 896.0 39.025776 ... 40.140799 39.025776
6 896.0 39.025776 ... 39.025776 39.025776
7 1024.0 49.932191 ... 53.773130 52.428801
8 1152.0 44.566925 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.888887 56.109587
10 1408.0 64.138541 ... 64.902096 57.997615
11 1536.0 78.643199 ... 76.106321 75.296679
12 1664.0 63.372618 ... 62.492442 62.061463
13 1792.0 72.983276 ... 70.246402 69.379162
14 1920.0 67.106797 ... 70.530615 70.530615
15 2048.0 73.908442 ... 74.898285 74.898285
16 2176.0 83.500614 ... 78.302130 80.173899
17 2304.0 68.446623 ... 73.501144 73.275679
18 2432.0 71.305746 ... 81.669953 81.197876
19 2560.0 77.833728 ... 76.740048 76.382283
20 2688.0 82.642823 ... 83.369354 80.027544
21 2816.0 79.879498 ... 77.330158 80.173175
22 2944.0 83.060049 ... 80.251257 78.235527
23 3072.0 81.943708 ... 84.512098 81.472093
24 3200.0 84.432717 ... 90.140846 84.099871
25 3328.0 83.034941 ... 87.794262 86.217120
26 3456.0 81.932484 ... 83.545665 85.767626
27 3584.0 87.211821 ... 92.220917 84.908450
28 3712.0 84.159518 ... 83.247783 82.082808
29 3840.0 80.197243 ... 81.439280 83.089406
30 3968.0 85.994800 ... 80.971427 82.226372
31 4096.0 93.596744 ... 89.597949 88.475759
10 1408.0 64.138541 ... 64.902096 64.902096
11 1536.0 80.430545 ... 76.933564 75.296679
12 1664.0 63.372618 ... 62.492442 62.492442
13 1792.0 72.983276 ... 70.246402 69.810085
14 1920.0 69.467336 ... 68.098521 70.172588
15 2048.0 73.584279 ... 74.898285 74.565406
16 2176.0 83.155572 ... 80.817862 79.855747
17 2304.0 68.446623 ... 73.501144 73.051599
18 2432.0 71.125224 ... 82.147552 81.669953
19 2560.0 77.649287 ... 77.283019 76.382283
20 2688.0 82.284288 ... 83.369354 83.922689
21 2816.0 81.369790 ... 78.021838 80.026067
22 2944.0 80.902653 ... 79.865439 78.112900
23 3072.0 82.062468 ... 84.010539 78.862262
24 3200.0 84.321474 ... 89.761569 89.887639
25 3328.0 80.707733 ... 84.795401 86.528001
26 3456.0 82.183044 ... 85.133652 80.945348
27 3584.0 87.381330 ... 94.847460 87.127323
28 3712.0 84.159518 ... 85.019017 86.341700
29 3840.0 82.840447 ... 88.615388 87.424508
30 3968.0 93.006050 ... 83.750126 83.179234
31 4096.0 93.662059 ... 83.313299 90.626421
[32 rows x 5 columns]
@@ -511,7 +511,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 2 minutes 23.846 seconds)
**Total running time of the script:** ( 2 minutes 12.078 seconds)
.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:

8
_sources/getting-started/tutorials/sg_execution_times.rst.txt
View File

@@ -5,12 +5,12 @@
Computation times
=================
**03:47.500** total execution time for **getting-started_tutorials** files:
**03:35.716** total execution time for **getting-started_tutorials** files:
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:23.846 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:12.078 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.632 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.611 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:11.022 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:11.027 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+

4
getting-started/tutorials/01-vector-add.html
View File

@@ -325,7 +325,7 @@ for different problem sizes.</p>
3 32768.0 76.800002 76.800002
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
6 262144.0 341.333321 341.333321
6 262144.0 341.333321 384.000001
7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016
9 2097152.0 722.823517 722.823517
@@ -337,7 +337,7 @@ for different problem sizes.</p>
15 134217728.0 851.577704 850.656574
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 11.022 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 11.027 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>

16
getting-started/tutorials/02-fused-softmax.html
View File

@@ -386,16 +386,16 @@ We will then compare its performance against (1) <code class="code docutils lite
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>softmax-performance:
N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 585.142862 151.703707
1 384.0 585.142862 585.142862 153.600004
2 512.0 630.153853 606.814814 154.566038
3 640.0 660.645170 640.000002 160.000000
3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ...
93 12160.0 812.359066 405.755985 199.038365
94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 411.722274 198.954424
96 12544.0 809.290334 412.971190 199.209928
97 12672.0 811.007961 412.097543 199.264875
93 12160.0 812.359066 406.179533 198.936606
94 12288.0 812.429770 415.661740 199.197579
95 12416.0 810.840807 412.149375 198.854847
96 12544.0 809.290334 412.546756 199.111113
97 12672.0 811.007961 412.097543 199.167004
[98 rows x 4 columns]
</pre></div>
@@ -409,7 +409,7 @@ This means that – when temporary data is too large to fit entirely in the GPU
Note that our Triton kernel is not only faster than PyTorch’s CUDA kernel, it is also <strong>easier to read, understand and maintain</strong>.</p></li>
</ul>
</div></blockquote>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.632 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.611 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>

56
getting-started/tutorials/03-matrix-multiplication.html
View File

@@ -575,42 +575,42 @@ torch_output=tensor([[ 1.1045, -36.9688, 31.4688, ..., -11.3906, 24.4531, -3
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 128.0 0.455111 ... 0.512000 0.512000
1 256.0 2.730667 ... 3.276800 2.978909
2 384.0 7.372800 ... 8.507077 8.507077
3 512.0 14.563555 ... 16.384000 16.384000
4 640.0 22.260869 ... 24.380953 24.380953
1 256.0 2.978909 ... 2.978909 2.978909
2 384.0 7.372800 ... 8.507077 7.899428
3 512.0 14.563555 ... 16.384000 15.420235
4 640.0 22.260869 ... 23.272727 23.272727
5 768.0 32.768000 ... 34.028308 34.028308
6 896.0 39.025776 ... 40.140799 39.025776
6 896.0 39.025776 ... 39.025776 39.025776
7 1024.0 49.932191 ... 53.773130 52.428801
8 1152.0 44.566925 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.888887 56.109587
10 1408.0 64.138541 ... 64.902096 57.997615
11 1536.0 78.643199 ... 76.106321 75.296679
12 1664.0 63.372618 ... 62.492442 62.061463
13 1792.0 72.983276 ... 70.246402 69.379162
14 1920.0 67.106797 ... 70.530615 70.530615
15 2048.0 73.908442 ... 74.898285 74.898285
16 2176.0 83.500614 ... 78.302130 80.173899
17 2304.0 68.446623 ... 73.501144 73.275679
18 2432.0 71.305746 ... 81.669953 81.197876
19 2560.0 77.833728 ... 76.740048 76.382283
20 2688.0 82.642823 ... 83.369354 80.027544
21 2816.0 79.879498 ... 77.330158 80.173175
22 2944.0 83.060049 ... 80.251257 78.235527
23 3072.0 81.943708 ... 84.512098 81.472093
24 3200.0 84.432717 ... 90.140846 84.099871
25 3328.0 83.034941 ... 87.794262 86.217120
26 3456.0 81.932484 ... 83.545665 85.767626
27 3584.0 87.211821 ... 92.220917 84.908450
28 3712.0 84.159518 ... 83.247783 82.082808
29 3840.0 80.197243 ... 81.439280 83.089406
30 3968.0 85.994800 ... 80.971427 82.226372
31 4096.0 93.596744 ... 89.597949 88.475759
10 1408.0 64.138541 ... 64.902096 64.902096
11 1536.0 80.430545 ... 76.933564 75.296679
12 1664.0 63.372618 ... 62.492442 62.492442
13 1792.0 72.983276 ... 70.246402 69.810085
14 1920.0 69.467336 ... 68.098521 70.172588
15 2048.0 73.584279 ... 74.898285 74.565406
16 2176.0 83.155572 ... 80.817862 79.855747
17 2304.0 68.446623 ... 73.501144 73.051599
18 2432.0 71.125224 ... 82.147552 81.669953
19 2560.0 77.649287 ... 77.283019 76.382283
20 2688.0 82.284288 ... 83.369354 83.922689
21 2816.0 81.369790 ... 78.021838 80.026067
22 2944.0 80.902653 ... 79.865439 78.112900
23 3072.0 82.062468 ... 84.010539 78.862262
24 3200.0 84.321474 ... 89.761569 89.887639
25 3328.0 80.707733 ... 84.795401 86.528001
26 3456.0 82.183044 ... 85.133652 80.945348
27 3584.0 87.381330 ... 94.847460 87.127323
28 3712.0 84.159518 ... 85.019017 86.341700
29 3840.0 82.840447 ... 88.615388 87.424508
30 3968.0 93.006050 ... 83.750126 83.179234
31 4096.0 93.662059 ... 83.313299 90.626421
[32 rows x 5 columns]
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 23.846 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 12.078 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>

8
getting-started/tutorials/sg_execution_times.html
View File

@@ -174,7 +174,7 @@
<div class="section" id="computation-times">
<span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1>
<p><strong>03:47.500</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<p><strong>03:35.716</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<table class="docutils align-default">
<colgroup>
<col style="width: 85%" />
@@ -183,15 +183,15 @@
</colgroup>
<tbody>
<tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
<td><p>02:23.846</p></td>
<td><p>02:12.078</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
<td><p>01:12.632</p></td>
<td><p>01:12.611</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-odd"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
<td><p>00:11.022</p></td>
<td><p>00:11.027</p></td>
<td><p>0.0 MB</p></td>
</tr>
</tbody>

2
searchindex.js
View File

File diff suppressed because one or more lines are too long