gaspersic/triton
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

[GH-PAGES] Updated website

Browse Source
This commit is contained in:
Philippe Tillet
2021-08-16 00:13:29 +00:00
parent 10215193e4
commit 85b5fdb059
17 changed files with 91 additions and 91 deletions
Download Patch File Download Diff File Expand all files Collapse all files

BIN
_downloads/662999063954282841dc90b8945f85ce/tutorials_jupyter.zip
View File

Binary file not shown.

BIN
_downloads/763344228ae6bc253ed1a6cf586aa30d/tutorials_python.zip
View File

Binary file not shown.

BIN
_images/sphx_glr_01-vector-add_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 23 KiB

BIN
_images/sphx_glr_01-vector-add_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 15 KiB

After

Width:  |  Height:  |  Size: 15 KiB

BIN
_images/sphx_glr_02-fused-softmax_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 37 KiB

After

Width:  |  Height:  |  Size: 37 KiB

BIN
_images/sphx_glr_02-fused-softmax_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 24 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_001.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 54 KiB

After

Width:  |  Height:  |  Size: 55 KiB

BIN
_images/sphx_glr_03-matrix-multiplication_thumb.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 31 KiB

After

Width:  |  Height:  |  Size: 32 KiB

8
_sources/getting-started/tutorials/01-vector-add.rst.txt
View File

@@ -232,12 +232,12 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
vector-add-performance:
size Triton Torch
0 4096.0 9.600000 9.600000
1 8192.0 19.200000 19.200000
2 16384.0 31.999999 31.999999
1 8192.0 19.200000 15.999999
2 16384.0 38.400001 38.400001
3 32768.0 76.800002 76.800002
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
6 262144.0 384.000001 384.000001
6 262144.0 384.000001 341.333321
7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016
9 2097152.0 722.823517 722.823517
@@ -254,7 +254,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 11.072 seconds)
**Total running time of the script:** ( 0 minutes 11.086 seconds)
.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:

16
_sources/getting-started/tutorials/02-fused-softmax.rst.txt
View File

@@ -301,16 +301,16 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
softmax-performance:
N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 585.142862 151.703707
2 512.0 655.360017 606.814814 156.038096
1 384.0 585.142862 585.142862 153.600004
2 512.0 630.153853 606.814814 154.566038
3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ...
93 12160.0 812.359066 405.755985 198.936606
94 12288.0 812.429770 415.661740 199.197579
95 12416.0 810.840807 411.722274 198.854847
96 12544.0 810.925276 412.971190 199.012395
97 12672.0 811.007961 412.097543 199.167004
93 12160.0 812.359066 405.755985 199.140227
94 12288.0 812.429770 415.661740 199.399583
95 12416.0 810.840807 411.722274 199.054102
96 12544.0 810.925276 412.546756 199.308841
97 12672.0 811.007961 412.097543 199.362843
[98 rows x 4 columns]
@@ -328,7 +328,7 @@ In the above plot, we can see that:
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 1 minutes 12.710 seconds)
**Total running time of the script:** ( 1 minutes 12.683 seconds)
.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:

58
_sources/getting-started/tutorials/03-matrix-multiplication.rst.txt
View File

@@ -463,37 +463,37 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 128.0 0.455111 ... 0.512000 0.512000
1 256.0 2.730667 ... 2.978909 2.978909
2 384.0 7.372800 ... 8.507077 8.507077
3 512.0 14.563555 ... 16.384000 16.384000
1 256.0 2.730667 ... 3.276800 2.978909
2 384.0 7.372800 ... 8.507077 7.899428
3 512.0 14.563555 ... 15.420235 15.420235
4 640.0 22.260869 ... 24.380953 24.380953
5 768.0 32.768000 ... 34.028308 34.028308
6 896.0 39.025776 ... 40.140799 39.025776
7 1024.0 49.932191 ... 53.773130 52.428801
8 1152.0 45.242181 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.888887 56.109587
10 1408.0 64.138541 ... 64.902096 58.621246
11 1536.0 78.643199 ... 76.106321 75.296679
12 1664.0 63.372618 ... 62.492442 61.217089
13 1792.0 72.512412 ... 69.810085 69.379162
14 1920.0 69.120002 ... 70.892307 70.530615
15 2048.0 73.908442 ... 75.234154 74.565406
16 2176.0 83.500614 ... 81.143743 79.226957
17 2304.0 68.251065 ... 73.728002 73.275679
18 2432.0 71.305746 ... 82.388456 81.908060
19 2560.0 77.833728 ... 77.465723 74.983980
20 2688.0 84.108772 ... 81.752274 82.284288
21 2816.0 82.446516 ... 78.442822 78.301990
22 2944.0 82.102191 ... 79.737653 78.854483
23 3072.0 82.420822 ... 84.010539 83.269271
24 3200.0 84.321474 ... 90.523334 84.656085
25 3328.0 82.369902 ... 86.736504 86.632127
26 3456.0 81.932484 ... 81.189898 84.686523
27 3584.0 87.127323 ... 90.549237 92.887804
28 3712.0 85.528545 ... 88.092894 88.797643
29 3840.0 84.809814 ... 88.544438 87.355452
30 3968.0 92.864488 ... 87.976885 87.347124
31 4096.0 93.662059 ... 86.480498 86.536250
7 1024.0 49.932191 ... 52.428801 52.428801
8 1152.0 44.566925 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.109587 56.109587
10 1408.0 64.138541 ... 64.902096 64.138541
11 1536.0 79.526831 ... 76.106321 75.296679
12 1664.0 63.372618 ... 62.492442 62.492442
13 1792.0 72.983276 ... 70.246402 69.810085
14 1920.0 66.782607 ... 68.435645 69.467336
15 2048.0 73.262953 ... 75.234154 68.191406
16 2176.0 82.813365 ... 81.143743 77.398646
17 2304.0 68.056616 ... 73.501144 73.051599
18 2432.0 71.125224 ... 80.731218 80.499895
19 2560.0 77.649287 ... 77.283019 76.382283
20 2688.0 81.752274 ... 82.642823 81.752274
21 2816.0 83.873477 ... 79.298560 79.154642
22 2944.0 81.431424 ... 79.993627 76.907458
23 3072.0 81.825298 ... 83.514905 82.782312
24 3200.0 80.604535 ... 85.106381 89.510493
25 3328.0 83.905938 ... 82.558825 81.622783
26 3456.0 81.849303 ... 84.244062 84.244062
27 3584.0 87.211821 ... 90.458141 92.887804
28 3712.0 85.601834 ... 88.955779 88.797643
29 3840.0 84.874902 ... 83.214447 85.136259
30 3968.0 88.938731 ... 88.487262 87.723894
31 4096.0 93.727466 ... 88.709668 88.475759
[32 rows x 5 columns]
@@ -503,7 +503,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 2 minutes 14.717 seconds)
**Total running time of the script:** ( 2 minutes 9.474 seconds)
.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:

8
_sources/getting-started/tutorials/sg_execution_times.rst.txt
View File

@@ -5,12 +5,12 @@
Computation times
=================
**03:38.499** total execution time for **getting-started_tutorials** files:
**03:33.244** total execution time for **getting-started_tutorials** files:
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:14.717 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:09.474 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.710 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.683 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:11.072 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:11.086 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+

8
getting-started/tutorials/01-vector-add.html
View File

@@ -320,12 +320,12 @@ for different problem sizes.</p>
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>vector-add-performance:
size Triton Torch
0 4096.0 9.600000 9.600000
1 8192.0 19.200000 19.200000
2 16384.0 31.999999 31.999999
1 8192.0 19.200000 15.999999
2 16384.0 38.400001 38.400001
3 32768.0 76.800002 76.800002
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
6 262144.0 384.000001 384.000001
6 262144.0 384.000001 341.333321
7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016
9 2097152.0 722.823517 722.823517
@@ -337,7 +337,7 @@ for different problem sizes.</p>
15 134217728.0 851.577704 850.656574
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 11.072 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 11.086 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>

16
getting-started/tutorials/02-fused-softmax.html
View File

@@ -386,16 +386,16 @@ We will then compare its performance against (1) <code class="code docutils lite
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>softmax-performance:
N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 585.142862 151.703707
2 512.0 655.360017 606.814814 156.038096
1 384.0 585.142862 585.142862 153.600004
2 512.0 630.153853 606.814814 154.566038
3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ...
93 12160.0 812.359066 405.755985 198.936606
94 12288.0 812.429770 415.661740 199.197579
95 12416.0 810.840807 411.722274 198.854847
96 12544.0 810.925276 412.971190 199.012395
97 12672.0 811.007961 412.097543 199.167004
93 12160.0 812.359066 405.755985 199.140227
94 12288.0 812.429770 415.661740 199.399583
95 12416.0 810.840807 411.722274 199.054102
96 12544.0 810.925276 412.546756 199.308841
97 12672.0 811.007961 412.097543 199.362843
[98 rows x 4 columns]
</pre></div>
@@ -408,7 +408,7 @@ We will then compare its performance against (1) <code class="code docutils lite
Note however that the PyTorch <cite>softmax</cite> operation is more general and will works on tensors of any shape.</p></li>
</ul>
</div></blockquote>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.710 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.683 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>

58
getting-started/tutorials/03-matrix-multiplication.html
View File

@@ -567,42 +567,42 @@ torch_output=tensor([[ 1.1045, -36.9688, 31.4688, ..., -11.3906, 24.4531, -3
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 128.0 0.455111 ... 0.512000 0.512000
1 256.0 2.730667 ... 2.978909 2.978909
2 384.0 7.372800 ... 8.507077 8.507077
3 512.0 14.563555 ... 16.384000 16.384000
1 256.0 2.730667 ... 3.276800 2.978909
2 384.0 7.372800 ... 8.507077 7.899428
3 512.0 14.563555 ... 15.420235 15.420235
4 640.0 22.260869 ... 24.380953 24.380953
5 768.0 32.768000 ... 34.028308 34.028308
6 896.0 39.025776 ... 40.140799 39.025776
7 1024.0 49.932191 ... 53.773130 52.428801
8 1152.0 45.242181 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.888887 56.109587
10 1408.0 64.138541 ... 64.902096 58.621246
11 1536.0 78.643199 ... 76.106321 75.296679
12 1664.0 63.372618 ... 62.492442 61.217089
13 1792.0 72.512412 ... 69.810085 69.379162
14 1920.0 69.120002 ... 70.892307 70.530615
15 2048.0 73.908442 ... 75.234154 74.565406
16 2176.0 83.500614 ... 81.143743 79.226957
17 2304.0 68.251065 ... 73.728002 73.275679
18 2432.0 71.305746 ... 82.388456 81.908060
19 2560.0 77.833728 ... 77.465723 74.983980
20 2688.0 84.108772 ... 81.752274 82.284288
21 2816.0 82.446516 ... 78.442822 78.301990
22 2944.0 82.102191 ... 79.737653 78.854483
23 3072.0 82.420822 ... 84.010539 83.269271
24 3200.0 84.321474 ... 90.523334 84.656085
25 3328.0 82.369902 ... 86.736504 86.632127
26 3456.0 81.932484 ... 81.189898 84.686523
27 3584.0 87.127323 ... 90.549237 92.887804
28 3712.0 85.528545 ... 88.092894 88.797643
29 3840.0 84.809814 ... 88.544438 87.355452
30 3968.0 92.864488 ... 87.976885 87.347124
31 4096.0 93.662059 ... 86.480498 86.536250
7 1024.0 49.932191 ... 52.428801 52.428801
8 1152.0 44.566925 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.109587 56.109587
10 1408.0 64.138541 ... 64.902096 64.138541
11 1536.0 79.526831 ... 76.106321 75.296679
12 1664.0 63.372618 ... 62.492442 62.492442
13 1792.0 72.983276 ... 70.246402 69.810085
14 1920.0 66.782607 ... 68.435645 69.467336
15 2048.0 73.262953 ... 75.234154 68.191406
16 2176.0 82.813365 ... 81.143743 77.398646
17 2304.0 68.056616 ... 73.501144 73.051599
18 2432.0 71.125224 ... 80.731218 80.499895
19 2560.0 77.649287 ... 77.283019 76.382283
20 2688.0 81.752274 ... 82.642823 81.752274
21 2816.0 83.873477 ... 79.298560 79.154642
22 2944.0 81.431424 ... 79.993627 76.907458
23 3072.0 81.825298 ... 83.514905 82.782312
24 3200.0 80.604535 ... 85.106381 89.510493
25 3328.0 83.905938 ... 82.558825 81.622783
26 3456.0 81.849303 ... 84.244062 84.244062
27 3584.0 87.211821 ... 90.458141 92.887804
28 3712.0 85.601834 ... 88.955779 88.797643
29 3840.0 84.874902 ... 83.214447 85.136259
30 3968.0 88.938731 ... 88.487262 87.723894
31 4096.0 93.727466 ... 88.709668 88.475759
[32 rows x 5 columns]
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 14.717 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 9.474 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>

8
getting-started/tutorials/sg_execution_times.html
View File

@@ -174,7 +174,7 @@
<div class="section" id="computation-times">
<span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1>
<p><strong>03:38.499</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<p><strong>03:33.244</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<table class="docutils align-default">
<colgroup>
<col style="width: 85%" />
@@ -183,15 +183,15 @@
</colgroup>
<tbody>
<tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
<td><p>02:14.717</p></td>
<td><p>02:09.474</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
<td><p>01:12.710</p></td>
<td><p>01:12.683</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-odd"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
<td><p>00:11.072</p></td>
<td><p>00:11.086</p></td>
<td><p>0.0 MB</p></td>
</tr>
</tbody>

2
searchindex.js
View File

File diff suppressed because one or more lines are too long