[GH-PAGES] Updated website

This commit is contained in:
Philippe Tillet
2021-08-11 00:20:37 +00:00
parent 0875eac4b7
commit 0d87b83ce7
17 changed files with 81 additions and 81 deletions

Binary file not shown.

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 23 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 15 KiB

After

Width:  |  Height:  |  Size: 15 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 37 KiB

After

Width:  |  Height:  |  Size: 37 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 24 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 54 KiB

After

Width:  |  Height:  |  Size: 55 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 32 KiB

After

Width:  |  Height:  |  Size: 32 KiB

View File

@@ -254,7 +254,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
.. rst-class:: sphx-glr-timing .. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 11.027 seconds) **Total running time of the script:** ( 0 minutes 11.050 seconds)
.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py: .. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:

View File

@@ -302,15 +302,15 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
N Triton Torch (native) Torch (jit) N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 186.181817 0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 585.142862 153.600004 1 384.0 585.142862 585.142862 153.600004
2 512.0 630.153853 606.814814 154.566038 2 512.0 630.153853 585.142849 154.566038
3 640.0 682.666684 640.000002 160.000000 3 640.0 660.645170 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992 4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ... .. ... ... ... ...
93 12160.0 812.359066 406.179533 198.936606 93 12160.0 812.359066 405.755985 199.038365
94 12288.0 812.429770 415.661740 199.197579 94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 412.149375 198.854847 95 12416.0 810.840807 412.149375 198.954424
96 12544.0 809.290334 412.546756 199.111113 96 12544.0 810.925276 412.971190 199.209928
97 12672.0 811.007961 412.097543 199.167004 97 12672.0 811.007961 412.097543 199.264875
[98 rows x 4 columns] [98 rows x 4 columns]
@@ -329,7 +329,7 @@ In the above plot, we can see that:
.. rst-class:: sphx-glr-timing .. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 1 minutes 12.611 seconds) **Total running time of the script:** ( 1 minutes 12.603 seconds)
.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py: .. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:

View File

@@ -471,37 +471,37 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
matmul-performance: matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU) M cuBLAS ... Triton Triton (+ LeakyReLU)
0 128.0 0.455111 ... 0.512000 0.512000 0 128.0 0.455111 ... 0.512000 0.512000
1 256.0 2.978909 ... 2.978909 2.978909 1 256.0 2.730667 ... 2.978909 2.978909
2 384.0 7.372800 ... 8.507077 7.899428 2 384.0 7.372800 ... 8.507077 8.507077
3 512.0 14.563555 ... 16.384000 15.420235 3 512.0 14.563555 ... 15.420235 15.420235
4 640.0 22.260869 ... 23.272727 23.272727 4 640.0 22.260869 ... 24.380953 24.380953
5 768.0 32.768000 ... 34.028308 34.028308 5 768.0 32.768000 ... 34.028308 34.028308
6 896.0 39.025776 ... 39.025776 39.025776 6 896.0 39.025776 ... 40.140799 39.025776
7 1024.0 49.932191 ... 53.773130 52.428801 7 1024.0 49.932191 ... 53.773130 52.428801
8 1152.0 44.566925 ... 46.656000 46.656000 8 1152.0 44.566925 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.888887 56.109587 9 1280.0 51.200001 ... 56.888887 56.109587
10 1408.0 64.138541 ... 64.902096 64.902096 10 1408.0 64.138541 ... 64.902096 64.902096
11 1536.0 80.430545 ... 76.933564 75.296679 11 1536.0 80.430545 ... 76.106321 76.106321
12 1664.0 63.372618 ... 62.492442 62.492442 12 1664.0 63.372618 ... 62.492442 62.061463
13 1792.0 72.983276 ... 70.246402 69.810085 13 1792.0 72.983276 ... 69.810085 69.810085
14 1920.0 69.467336 ... 68.098521 70.172588 14 1920.0 69.467336 ... 69.467336 68.098521
15 2048.0 73.584279 ... 74.898285 74.565406 15 2048.0 73.584279 ... 75.234154 68.200062
16 2176.0 83.155572 ... 80.817862 79.855747 16 2176.0 82.813365 ... 78.916269 79.855747
17 2304.0 68.446623 ... 73.501144 73.051599 17 2304.0 68.446623 ... 73.275679 73.275679
18 2432.0 71.125224 ... 82.147552 81.669953 18 2432.0 71.125224 ... 82.147552 81.197876
19 2560.0 77.649287 ... 77.283019 76.382283 19 2560.0 77.833728 ... 76.027843 75.328737
20 2688.0 82.284288 ... 83.369354 83.922689 20 2688.0 82.642823 ... 83.004501 83.737433
21 2816.0 81.369790 ... 78.021838 80.026067 21 2816.0 82.759409 ... 78.726003 79.443003
22 2944.0 80.902653 ... 79.865439 78.112900 22 2944.0 80.771529 ... 80.122235 77.505492
23 3072.0 82.062468 ... 84.010539 78.862262 23 3072.0 81.707223 ... 82.062468 83.146995
24 3200.0 84.321474 ... 89.761569 89.887639 24 3200.0 80.301128 ... 86.253369 88.888888
25 3328.0 80.707733 ... 84.795401 86.528001 25 3328.0 82.939284 ... 86.632127 81.994643
26 3456.0 82.183044 ... 85.133652 80.945348 26 3456.0 81.849303 ... 85.494768 84.686523
27 3584.0 87.381330 ... 94.847460 87.127323 27 3584.0 84.190443 ... 95.553020 95.654673
28 3712.0 84.159518 ... 85.019017 86.341700 28 3712.0 82.423549 ... 88.797643 84.230479
29 3840.0 82.840447 ... 88.615388 87.424508 29 3840.0 82.716526 ... 83.214447 81.317647
30 3968.0 93.006050 ... 83.750126 83.179234 30 3968.0 88.809270 ... 82.392935 83.807647
31 4096.0 93.662059 ... 83.313299 90.626421 31 4096.0 93.531519 ... 89.777746 89.359338
[32 rows x 5 columns] [32 rows x 5 columns]
@@ -511,7 +511,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
.. rst-class:: sphx-glr-timing .. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 2 minutes 12.078 seconds) **Total running time of the script:** ( 2 minutes 14.775 seconds)
.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py: .. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:

View File

@@ -5,12 +5,12 @@
Computation times Computation times
================= =================
**03:35.716** total execution time for **getting-started_tutorials** files: **03:38.428** total execution time for **getting-started_tutorials** files:
+---------------------------------------------------------------------------------------------------------+-----------+--------+ +---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:12.078 | 0.0 MB | | :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:14.775 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+ +---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.611 | 0.0 MB | | :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.603 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+ +---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:11.027 | 0.0 MB | | :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:11.050 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+ +---------------------------------------------------------------------------------------------------------+-----------+--------+

View File

@@ -337,7 +337,7 @@ for different problem sizes.</p>
15 134217728.0 851.577704 850.656574 15 134217728.0 851.577704 850.656574
</pre></div> </pre></div>
</div> </div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 11.027 seconds)</p> <p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 11.050 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py"> <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container"> <div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p> <p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>

View File

@@ -387,15 +387,15 @@ We will then compare its performance against (1) <code class="code docutils lite
N Triton Torch (native) Torch (jit) N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 186.181817 0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 585.142862 153.600004 1 384.0 585.142862 585.142862 153.600004
2 512.0 630.153853 606.814814 154.566038 2 512.0 630.153853 585.142849 154.566038
3 640.0 682.666684 640.000002 160.000000 3 640.0 660.645170 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992 4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ... .. ... ... ... ...
93 12160.0 812.359066 406.179533 198.936606 93 12160.0 812.359066 405.755985 199.038365
94 12288.0 812.429770 415.661740 199.197579 94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 412.149375 198.854847 95 12416.0 810.840807 412.149375 198.954424
96 12544.0 809.290334 412.546756 199.111113 96 12544.0 810.925276 412.971190 199.209928
97 12672.0 811.007961 412.097543 199.167004 97 12672.0 811.007961 412.097543 199.264875
[98 rows x 4 columns] [98 rows x 4 columns]
</pre></div> </pre></div>
@@ -409,7 +409,7 @@ This means that when temporary data is too large to fit entirely in the GPU
Note that our Triton kernel is not only faster than PyTorchs CUDA kernel, it is also <strong>easier to read, understand and maintain</strong>.</p></li> Note that our Triton kernel is not only faster than PyTorchs CUDA kernel, it is also <strong>easier to read, understand and maintain</strong>.</p></li>
</ul> </ul>
</div></blockquote> </div></blockquote>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.611 seconds)</p> <p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.603 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py"> <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container"> <div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p> <p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>

View File

@@ -575,42 +575,42 @@ torch_output=tensor([[ 1.1045, -36.9688, 31.4688, ..., -11.3906, 24.4531, -3
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance: <div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU) M cuBLAS ... Triton Triton (+ LeakyReLU)
0 128.0 0.455111 ... 0.512000 0.512000 0 128.0 0.455111 ... 0.512000 0.512000
1 256.0 2.978909 ... 2.978909 2.978909 1 256.0 2.730667 ... 2.978909 2.978909
2 384.0 7.372800 ... 8.507077 7.899428 2 384.0 7.372800 ... 8.507077 8.507077
3 512.0 14.563555 ... 16.384000 15.420235 3 512.0 14.563555 ... 15.420235 15.420235
4 640.0 22.260869 ... 23.272727 23.272727 4 640.0 22.260869 ... 24.380953 24.380953
5 768.0 32.768000 ... 34.028308 34.028308 5 768.0 32.768000 ... 34.028308 34.028308
6 896.0 39.025776 ... 39.025776 39.025776 6 896.0 39.025776 ... 40.140799 39.025776
7 1024.0 49.932191 ... 53.773130 52.428801 7 1024.0 49.932191 ... 53.773130 52.428801
8 1152.0 44.566925 ... 46.656000 46.656000 8 1152.0 44.566925 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.888887 56.109587 9 1280.0 51.200001 ... 56.888887 56.109587
10 1408.0 64.138541 ... 64.902096 64.902096 10 1408.0 64.138541 ... 64.902096 64.902096
11 1536.0 80.430545 ... 76.933564 75.296679 11 1536.0 80.430545 ... 76.106321 76.106321
12 1664.0 63.372618 ... 62.492442 62.492442 12 1664.0 63.372618 ... 62.492442 62.061463
13 1792.0 72.983276 ... 70.246402 69.810085 13 1792.0 72.983276 ... 69.810085 69.810085
14 1920.0 69.467336 ... 68.098521 70.172588 14 1920.0 69.467336 ... 69.467336 68.098521
15 2048.0 73.584279 ... 74.898285 74.565406 15 2048.0 73.584279 ... 75.234154 68.200062
16 2176.0 83.155572 ... 80.817862 79.855747 16 2176.0 82.813365 ... 78.916269 79.855747
17 2304.0 68.446623 ... 73.501144 73.051599 17 2304.0 68.446623 ... 73.275679 73.275679
18 2432.0 71.125224 ... 82.147552 81.669953 18 2432.0 71.125224 ... 82.147552 81.197876
19 2560.0 77.649287 ... 77.283019 76.382283 19 2560.0 77.833728 ... 76.027843 75.328737
20 2688.0 82.284288 ... 83.369354 83.922689 20 2688.0 82.642823 ... 83.004501 83.737433
21 2816.0 81.369790 ... 78.021838 80.026067 21 2816.0 82.759409 ... 78.726003 79.443003
22 2944.0 80.902653 ... 79.865439 78.112900 22 2944.0 80.771529 ... 80.122235 77.505492
23 3072.0 82.062468 ... 84.010539 78.862262 23 3072.0 81.707223 ... 82.062468 83.146995
24 3200.0 84.321474 ... 89.761569 89.887639 24 3200.0 80.301128 ... 86.253369 88.888888
25 3328.0 80.707733 ... 84.795401 86.528001 25 3328.0 82.939284 ... 86.632127 81.994643
26 3456.0 82.183044 ... 85.133652 80.945348 26 3456.0 81.849303 ... 85.494768 84.686523
27 3584.0 87.381330 ... 94.847460 87.127323 27 3584.0 84.190443 ... 95.553020 95.654673
28 3712.0 84.159518 ... 85.019017 86.341700 28 3712.0 82.423549 ... 88.797643 84.230479
29 3840.0 82.840447 ... 88.615388 87.424508 29 3840.0 82.716526 ... 83.214447 81.317647
30 3968.0 93.006050 ... 83.750126 83.179234 30 3968.0 88.809270 ... 82.392935 83.807647
31 4096.0 93.662059 ... 83.313299 90.626421 31 4096.0 93.531519 ... 89.777746 89.359338
[32 rows x 5 columns] [32 rows x 5 columns]
</pre></div> </pre></div>
</div> </div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 12.078 seconds)</p> <p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 14.775 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py"> <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container"> <div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p> <p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>

View File

@@ -174,7 +174,7 @@
<div class="section" id="computation-times"> <div class="section" id="computation-times">
<span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1> <span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1>
<p><strong>03:35.716</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p> <p><strong>03:38.428</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<table class="docutils align-default"> <table class="docutils align-default">
<colgroup> <colgroup>
<col style="width: 85%" /> <col style="width: 85%" />
@@ -183,15 +183,15 @@
</colgroup> </colgroup>
<tbody> <tbody>
<tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td> <tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
<td><p>02:12.078</p></td> <td><p>02:14.775</p></td>
<td><p>0.0 MB</p></td> <td><p>0.0 MB</p></td>
</tr> </tr>
<tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td> <tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
<td><p>01:12.611</p></td> <td><p>01:12.603</p></td>
<td><p>0.0 MB</p></td> <td><p>0.0 MB</p></td>
</tr> </tr>
<tr class="row-odd"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td> <tr class="row-odd"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
<td><p>00:11.027</p></td> <td><p>00:11.050</p></td>
<td><p>0.0 MB</p></td> <td><p>0.0 MB</p></td>
</tr> </tr>
</tbody> </tbody>

File diff suppressed because one or more lines are too long