gaspersic/triton
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[GH-PAGES] Updated website

Browse Source
This commit is contained in:
Philippe Tillet
2021-08-01 00:16:31 +00:00
parent ec78e18faf
commit 462b4d9bc9
17 changed files with 79 additions and 79 deletions
Download Patch File Download Diff File Expand all files Collapse all files

BIN
_downloads/662999063954282841dc90b8945f85ce/tutorials_jupyter.zip
View File

Binary file not shown.

BIN
_downloads/763344228ae6bc253ed1a6cf586aa30d/tutorials_python.zip
View File

Binary file not shown.

BIN
_images/sphx_glr_01-vector-add_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 23 KiB

BIN
_images/sphx_glr_01-vector-add_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 15 KiB

After

Width:  |  Height:  |  Size: 15 KiB

BIN
_images/sphx_glr_02-fused-softmax_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 39 KiB

After

Width:  |  Height:  |  Size: 39 KiB

BIN
_images/sphx_glr_02-fused-softmax_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 24 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 55 KiB

After

Width:  |  Height:  |  Size: 54 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 32 KiB

After

Width:  |  Height:  |  Size: 32 KiB

6
_sources/getting-started/tutorials/01-vector-add.rst.txt
View File

@@ -216,13 +216,13 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
vector-add-performance:
size Triton Torch
0 4096.0 9.600000 9.600000
0 4096.0 9.540372 9.600000
1 8192.0 19.200000 19.200000
2 16384.0 38.400001 38.400001
3 32768.0 76.800002 76.800002
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
6 262144.0 384.000001 384.000001
6 262144.0 341.333321 341.333321
7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016
9 2097152.0 722.823517 722.823517
@@ -239,7 +239,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 12.689 seconds)
**Total running time of the script:** ( 0 minutes 11.067 seconds)
.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:

16
_sources/getting-started/tutorials/02-fused-softmax.rst.txt
View File

@@ -262,16 +262,16 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
softmax-performance:
N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 273.066674
1 384.0 585.142862 585.142862 267.130429
1 384.0 585.142862 585.142862 261.446801
2 512.0 630.153853 606.814814 264.258068
3 640.0 682.666684 640.000002 269.473696
3 640.0 682.666684 640.000002 265.974036
4 768.0 702.171410 664.216187 273.066663
.. ... ... ... ...
93 12160.0 812.359066 406.179533 329.483481
94 12288.0 812.429770 415.661740 329.602681
95 12416.0 810.840807 412.149375 328.900662
96 12544.0 810.925276 412.971190 329.292871
97 12672.0 809.389265 412.097543 329.142870
93 12160.0 812.359066 405.755985 329.483481
94 12288.0 812.429770 415.222812 329.602681
95 12416.0 810.840807 412.149375 329.173158
96 12544.0 810.925276 412.971190 329.022957
97 12672.0 811.007961 412.097543 329.410251
[98 rows x 4 columns]
@@ -290,7 +290,7 @@ In the above plot, we can see that:
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 1 minutes 8.263 seconds)
**Total running time of the script:** ( 1 minutes 8.169 seconds)
.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:

48
_sources/getting-started/tutorials/03-matrix-multiplication.rst.txt
View File

@@ -372,36 +372,36 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 128.0 0.455111 ... 0.512000 0.512000
1 256.0 2.730667 ... 2.978909 2.978909
2 384.0 7.372800 ... 7.899428 7.899428
2 384.0 7.372800 ... 8.507077 8.507077
3 512.0 14.563555 ... 15.420235 15.420235
4 640.0 22.260869 ... 24.380953 24.380953
4 640.0 22.260869 ... 23.272727 23.272727
5 768.0 32.768000 ... 34.028308 34.028308
6 896.0 39.025776 ... 39.025776 37.971025
6 896.0 39.025776 ... 39.025776 39.025776
7 1024.0 49.932191 ... 52.428801 52.428801
8 1152.0 44.566925 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.109587 56.109587
10 1408.0 64.138541 ... 65.684049 65.684049
11 1536.0 80.430545 ... 76.106321 75.296679
11 1536.0 80.430545 ... 76.106321 76.106321
12 1664.0 63.372618 ... 61.636381 61.636381
13 1792.0 72.983276 ... 68.953520 68.533074
14 1920.0 65.516586 ... 67.764707 69.120002
15 2048.0 73.584279 ... 75.234154 74.898285
16 2176.0 82.473969 ... 78.302130 78.608000
17 2304.0 68.446623 ... 73.051599 72.607513
18 2432.0 71.305746 ... 80.499895 80.963875
19 2560.0 78.019048 ... 76.740048 74.983980
20 2688.0 83.737433 ... 83.552988 80.537273
21 2816.0 78.868366 ... 77.193289 78.442822
22 2944.0 81.166173 ... 80.122235 77.385141
23 3072.0 81.472093 ... 83.391907 81.121923
24 3200.0 82.368085 ... 86.021503 87.671229
25 3328.0 83.516586 ... 86.320498 82.939284
26 3456.0 81.849303 ... 80.783132 85.043848
27 3584.0 87.211821 ... 92.126428 84.663603
28 3712.0 84.088676 ... 84.301560 81.550936
29 3840.0 81.079177 ... 84.164384 85.267542
30 3968.0 92.442373 ... 84.038524 83.807647
31 4096.0 93.401342 ... 91.304576 91.056800
13 1792.0 72.983276 ... 69.379162 68.953520
14 1920.0 68.098521 ... 69.818184 69.818184
15 2048.0 73.584279 ... 75.234154 75.573044
16 2176.0 83.500614 ... 80.817862 80.494588
17 2304.0 68.251065 ... 73.051599 73.051599
18 2432.0 71.305746 ... 81.197876 81.197876
19 2560.0 77.833728 ... 76.740048 76.382283
20 2688.0 83.004501 ... 83.369354 85.051697
21 2816.0 81.067298 ... 75.982940 78.868366
22 2944.0 79.483304 ... 79.865439 79.230573
23 3072.0 81.589488 ... 83.146995 83.025078
24 3200.0 84.432717 ... 86.956520 89.385477
25 3328.0 84.003845 ... 82.843841 85.806075
26 3456.0 82.350937 ... 84.686523 84.508982
27 3584.0 84.111686 ... 92.032132 96.475743
28 3712.0 86.416391 ... 84.874549 88.170647
29 3840.0 85.005380 ... 87.771425 87.493673
30 3968.0 92.512459 ... 80.703662 84.797731
31 4096.0 93.727466 ... 90.995066 91.741443
[32 rows x 5 columns]
@@ -411,7 +411,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 2 minutes 10.315 seconds)
**Total running time of the script:** ( 1 minutes 58.805 seconds)
.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:

8
_sources/getting-started/tutorials/sg_execution_times.rst.txt
View File

@@ -5,12 +5,12 @@
Computation times
=================
**03:31.267** total execution time for **getting-started_tutorials** files:
**03:18.042** total execution time for **getting-started_tutorials** files:
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:10.315 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 01:58.805 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:08.263 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:08.169 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:12.689 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:11.067 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+

6
getting-started/tutorials/01-vector-add.html
View File

@@ -305,13 +305,13 @@ for different problem sizes.</p>
<p class="sphx-glr-script-out">Out:</p>
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>vector-add-performance:
size Triton Torch
0 4096.0 9.600000 9.600000
0 4096.0 9.540372 9.600000
1 8192.0 19.200000 19.200000
2 16384.0 38.400001 38.400001
3 32768.0 76.800002 76.800002
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
6 262144.0 384.000001 384.000001
6 262144.0 341.333321 341.333321
7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016
9 2097152.0 722.823517 722.823517
@@ -323,7 +323,7 @@ for different problem sizes.</p>
15 134217728.0 851.577704 850.656574
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 12.689 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 11.067 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>

16
getting-started/tutorials/02-fused-softmax.html
View File

@@ -347,16 +347,16 @@ We will then compare its performance against (1) <code class="code docutils lite
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>softmax-performance:
N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 273.066674
1 384.0 585.142862 585.142862 267.130429
1 384.0 585.142862 585.142862 261.446801
2 512.0 630.153853 606.814814 264.258068
3 640.0 682.666684 640.000002 269.473696
3 640.0 682.666684 640.000002 265.974036
4 768.0 702.171410 664.216187 273.066663
.. ... ... ... ...
93 12160.0 812.359066 406.179533 329.483481
94 12288.0 812.429770 415.661740 329.602681
95 12416.0 810.840807 412.149375 328.900662
96 12544.0 810.925276 412.971190 329.292871
97 12672.0 809.389265 412.097543 329.142870
93 12160.0 812.359066 405.755985 329.483481
94 12288.0 812.429770 415.222812 329.602681
95 12416.0 810.840807 412.149375 329.173158
96 12544.0 810.925276 412.971190 329.022957
97 12672.0 811.007961 412.097543 329.410251
[98 rows x 4 columns]
</pre></div>
@@ -370,7 +370,7 @@ This means that – when temporary data is too large to fit entirely in the GPU
Note that our Triton kernel is not only faster than PyTorch’s CUDA kernel, it is also <strong>easier to read, understand and maintain</strong>.</p></li>
</ul>
</div></blockquote>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 8.263 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 8.169 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>

48
getting-started/tutorials/03-matrix-multiplication.html
View File

@@ -477,41 +477,41 @@ tensor(True, device=&#39;cuda:0&#39;)
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 128.0 0.455111 ... 0.512000 0.512000
1 256.0 2.730667 ... 2.978909 2.978909
2 384.0 7.372800 ... 7.899428 7.899428
2 384.0 7.372800 ... 8.507077 8.507077
3 512.0 14.563555 ... 15.420235 15.420235
4 640.0 22.260869 ... 24.380953 24.380953
4 640.0 22.260869 ... 23.272727 23.272727
5 768.0 32.768000 ... 34.028308 34.028308
6 896.0 39.025776 ... 39.025776 37.971025
6 896.0 39.025776 ... 39.025776 39.025776
7 1024.0 49.932191 ... 52.428801 52.428801
8 1152.0 44.566925 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.109587 56.109587
10 1408.0 64.138541 ... 65.684049 65.684049
11 1536.0 80.430545 ... 76.106321 75.296679
11 1536.0 80.430545 ... 76.106321 76.106321
12 1664.0 63.372618 ... 61.636381 61.636381
13 1792.0 72.983276 ... 68.953520 68.533074
14 1920.0 65.516586 ... 67.764707 69.120002
15 2048.0 73.584279 ... 75.234154 74.898285
16 2176.0 82.473969 ... 78.302130 78.608000
17 2304.0 68.446623 ... 73.051599 72.607513
18 2432.0 71.305746 ... 80.499895 80.963875
19 2560.0 78.019048 ... 76.740048 74.983980
20 2688.0 83.737433 ... 83.552988 80.537273
21 2816.0 78.868366 ... 77.193289 78.442822
22 2944.0 81.166173 ... 80.122235 77.385141
23 3072.0 81.472093 ... 83.391907 81.121923
24 3200.0 82.368085 ... 86.021503 87.671229
25 3328.0 83.516586 ... 86.320498 82.939284
26 3456.0 81.849303 ... 80.783132 85.043848
27 3584.0 87.211821 ... 92.126428 84.663603
28 3712.0 84.088676 ... 84.301560 81.550936
29 3840.0 81.079177 ... 84.164384 85.267542
30 3968.0 92.442373 ... 84.038524 83.807647
31 4096.0 93.401342 ... 91.304576 91.056800
13 1792.0 72.983276 ... 69.379162 68.953520
14 1920.0 68.098521 ... 69.818184 69.818184
15 2048.0 73.584279 ... 75.234154 75.573044
16 2176.0 83.500614 ... 80.817862 80.494588
17 2304.0 68.251065 ... 73.051599 73.051599
18 2432.0 71.305746 ... 81.197876 81.197876
19 2560.0 77.833728 ... 76.740048 76.382283
20 2688.0 83.004501 ... 83.369354 85.051697
21 2816.0 81.067298 ... 75.982940 78.868366
22 2944.0 79.483304 ... 79.865439 79.230573
23 3072.0 81.589488 ... 83.146995 83.025078
24 3200.0 84.432717 ... 86.956520 89.385477
25 3328.0 84.003845 ... 82.843841 85.806075
26 3456.0 82.350937 ... 84.686523 84.508982
27 3584.0 84.111686 ... 92.032132 96.475743
28 3712.0 86.416391 ... 84.874549 88.170647
29 3840.0 85.005380 ... 87.771425 87.493673
30 3968.0 92.512459 ... 80.703662 84.797731
31 4096.0 93.727466 ... 90.995066 91.741443
[32 rows x 5 columns]
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 10.315 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 58.805 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>

8
getting-started/tutorials/sg_execution_times.html
View File

@@ -174,7 +174,7 @@
<div class="section" id="computation-times">
<span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1>
<p><strong>03:31.267</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<p><strong>03:18.042</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<table class="docutils align-default">
<colgroup>
<col style="width: 85%" />
@@ -183,15 +183,15 @@
</colgroup>
<tbody>
<tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
<td><p>02:10.315</p></td>
<td><p>01:58.805</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
<td><p>01:08.263</p></td>
<td><p>01:08.169</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-odd"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
<td><p>00:12.689</p></td>
<td><p>00:11.067</p></td>
<td><p>0.0 MB</p></td>
</tr>
</tbody>

2
searchindex.js
View File

File diff suppressed because one or more lines are too long