[GH-PAGES] Updated website

This commit is contained in:
Philippe Tillet
2021-08-07 00:13:37 +00:00
parent 1eee2d4137
commit 70479447be
17 changed files with 79 additions and 79 deletions

Binary file not shown.

Before

Width:  |  Height:  |  Size: 25 KiB

After

Width:  |  Height:  |  Size: 24 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 16 KiB

After

Width:  |  Height:  |  Size: 15 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 37 KiB

After

Width:  |  Height:  |  Size: 38 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 24 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 55 KiB

After

Width:  |  Height:  |  Size: 54 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 32 KiB

After

Width:  |  Height:  |  Size: 31 KiB

View File

@@ -237,7 +237,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
3 32768.0 76.800002 76.800002 3 32768.0 76.800002 76.800002
4 65536.0 127.999995 127.999995 4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568 5 131072.0 219.428568 219.428568
6 262144.0 341.333321 384.000001 6 262144.0 384.000001 384.000001
7 524288.0 472.615390 472.615390 7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016 8 1048576.0 614.400016 614.400016
9 2097152.0 722.823517 722.823517 9 2097152.0 722.823517 722.823517
@@ -254,7 +254,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
.. rst-class:: sphx-glr-timing .. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 10.987 seconds) **Total running time of the script:** ( 0 minutes 10.995 seconds)
.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py: .. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:

View File

@@ -306,11 +306,11 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
3 640.0 682.666684 640.000002 160.000000 3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992 4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ... .. ... ... ... ...
93 12160.0 812.359066 405.755985 199.038365 93 12160.0 812.359066 406.179533 199.038365
94 12288.0 812.429770 415.661740 199.298541 94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 412.149375 198.954424 95 12416.0 810.840807 412.149375 198.954424
96 12544.0 809.290334 412.546756 199.209928 96 12544.0 809.290334 412.971190 199.209928
97 12672.0 809.389265 412.097543 199.167004 97 12672.0 809.389265 412.097543 199.264875
[98 rows x 4 columns] [98 rows x 4 columns]
@@ -329,7 +329,7 @@ In the above plot, we can see that:
.. rst-class:: sphx-glr-timing .. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 1 minutes 12.618 seconds) **Total running time of the script:** ( 1 minutes 12.644 seconds)
.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py: .. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:

View File

@@ -470,38 +470,38 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
matmul-performance: matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU) M cuBLAS ... Triton Triton (+ LeakyReLU)
0 128.0 0.455111 ... 0.512000 0.512000 0 128.0 0.512000 ... 0.512000 0.512000
1 256.0 2.730667 ... 3.276800 2.978909 1 256.0 2.730667 ... 2.978909 2.978909
2 384.0 7.372800 ... 7.899428 7.899428 2 384.0 7.372800 ... 7.899428 7.899428
3 512.0 14.563555 ... 16.384000 16.384000 3 512.0 14.563555 ... 15.420235 15.420235
4 640.0 22.260869 ... 24.380953 24.380953 4 640.0 22.260869 ... 24.380953 23.272727
5 768.0 32.768000 ... 34.028308 34.028308 5 768.0 32.768000 ... 34.028308 34.028308
6 896.0 39.025776 ... 40.140799 35.150663 6 896.0 39.025776 ... 39.025776 37.971025
7 1024.0 49.932191 ... 52.428801 52.428801 7 1024.0 49.932191 ... 52.428801 52.428801
8 1152.0 44.566925 ... 46.656000 46.656000 8 1152.0 44.566925 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.109587 56.109587 9 1280.0 51.200001 ... 56.888887 56.109587
10 1408.0 64.138541 ... 64.902096 64.138541 10 1408.0 64.138541 ... 64.902096 58.016903
11 1536.0 80.430545 ... 76.106321 75.296679 11 1536.0 79.526831 ... 76.106321 75.296679
12 1664.0 62.929456 ... 62.061463 62.061463 12 1664.0 62.929456 ... 62.492442 62.492442
13 1792.0 72.983276 ... 69.810085 69.379162 13 1792.0 72.983276 ... 69.810085 69.810085
14 1920.0 69.120002 ... 70.892307 69.120002 14 1920.0 66.782607 ... 69.467336 69.120002
15 2048.0 73.584279 ... 74.898285 74.565406 15 2048.0 73.262953 ... 74.898285 74.565406
16 2176.0 83.155572 ... 80.817862 79.855747 16 2176.0 82.473969 ... 80.173899 77.398646
17 2304.0 68.446623 ... 72.828879 73.275679 17 2304.0 68.446623 ... 73.501144 73.501144
18 2432.0 71.305746 ... 82.388456 81.908060 18 2432.0 71.305746 ... 81.908060 81.908060
19 2560.0 78.019048 ... 77.283019 75.676673 19 2560.0 77.649287 ... 76.740048 75.328737
20 2688.0 83.552988 ... 83.552988 83.922689 20 2688.0 83.552988 ... 82.823267 81.928846
21 2816.0 81.827785 ... 77.330158 79.154642 21 2816.0 84.035084 ... 78.021838 79.733474
22 2944.0 81.166173 ... 77.747321 79.483304 22 2944.0 81.431424 ... 79.230573 77.990663
23 3072.0 79.863336 ... 82.661468 82.420822 23 3072.0 82.420822 ... 83.146995 80.774758
24 3200.0 83.660130 ... 90.395483 85.906037 24 3200.0 84.321474 ... 86.137280 90.140846
25 3328.0 83.226931 ... 87.368079 83.613586 25 3328.0 83.226931 ... 81.438120 86.946008
26 3456.0 80.220468 ... 81.600781 83.459178 26 3456.0 81.932484 ... 81.189898 85.133652
27 3584.0 87.466332 ... 92.887804 84.983685 27 3584.0 88.238857 ... 87.979837 89.468054
28 3712.0 84.159518 ... 83.178475 83.666116 28 3712.0 85.455380 ... 82.084920 86.044224
29 3840.0 83.591840 ... 84.228485 85.663823 29 3840.0 83.591840 ... 84.809814 85.333335
30 3968.0 91.885495 ... 84.680037 84.154440 30 3968.0 90.859224 ... 86.911637 86.296981
31 4096.0 89.181212 ... 90.260743 90.200084 31 4096.0 92.309303 ... 90.504200 90.382307
[32 rows x 5 columns] [32 rows x 5 columns]
@@ -511,7 +511,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
.. rst-class:: sphx-glr-timing .. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 2 minutes 29.710 seconds) **Total running time of the script:** ( 2 minutes 17.805 seconds)
.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py: .. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:

View File

@@ -5,12 +5,12 @@
Computation times Computation times
================= =================
**03:53.315** total execution time for **getting-started_tutorials** files: **03:41.443** total execution time for **getting-started_tutorials** files:
+---------------------------------------------------------------------------------------------------------+-----------+--------+ +---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:29.710 | 0.0 MB | | :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 02:17.805 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+ +---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.618 | 0.0 MB | | :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 01:12.644 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+ +---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:10.987 | 0.0 MB | | :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 00:10.995 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+ +---------------------------------------------------------------------------------------------------------+-----------+--------+

View File

@@ -325,7 +325,7 @@ for different problem sizes.</p>
3 32768.0 76.800002 76.800002 3 32768.0 76.800002 76.800002
4 65536.0 127.999995 127.999995 4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568 5 131072.0 219.428568 219.428568
6 262144.0 341.333321 384.000001 6 262144.0 384.000001 384.000001
7 524288.0 472.615390 472.615390 7 524288.0 472.615390 472.615390
8 1048576.0 614.400016 614.400016 8 1048576.0 614.400016 614.400016
9 2097152.0 722.823517 722.823517 9 2097152.0 722.823517 722.823517
@@ -337,7 +337,7 @@ for different problem sizes.</p>
15 134217728.0 851.577704 850.656574 15 134217728.0 851.577704 850.656574
</pre></div> </pre></div>
</div> </div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 10.987 seconds)</p> <p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 10.995 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py"> <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container"> <div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p> <p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>

View File

@@ -391,11 +391,11 @@ We will then compare its performance against (1) <code class="code docutils lite
3 640.0 682.666684 640.000002 160.000000 3 640.0 682.666684 640.000002 160.000000
4 768.0 702.171410 664.216187 163.839992 4 768.0 702.171410 664.216187 163.839992
.. ... ... ... ... .. ... ... ... ...
93 12160.0 812.359066 405.755985 199.038365 93 12160.0 812.359066 406.179533 199.038365
94 12288.0 812.429770 415.661740 199.298541 94 12288.0 812.429770 415.661740 199.298541
95 12416.0 810.840807 412.149375 198.954424 95 12416.0 810.840807 412.149375 198.954424
96 12544.0 809.290334 412.546756 199.209928 96 12544.0 809.290334 412.971190 199.209928
97 12672.0 809.389265 412.097543 199.167004 97 12672.0 809.389265 412.097543 199.264875
[98 rows x 4 columns] [98 rows x 4 columns]
</pre></div> </pre></div>
@@ -409,7 +409,7 @@ This means that when temporary data is too large to fit entirely in the GPU
Note that our Triton kernel is not only faster than PyTorchs CUDA kernel, it is also <strong>easier to read, understand and maintain</strong>.</p></li> Note that our Triton kernel is not only faster than PyTorchs CUDA kernel, it is also <strong>easier to read, understand and maintain</strong>.</p></li>
</ul> </ul>
</div></blockquote> </div></blockquote>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.618 seconds)</p> <p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 12.644 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py"> <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container"> <div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p> <p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>

View File

@@ -574,43 +574,43 @@ torch_output=tensor([[ 1.1045, -36.9688, 31.4688, ..., -11.3906, 24.4531, -3
<p class="sphx-glr-script-out">Out:</p> <p class="sphx-glr-script-out">Out:</p>
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance: <div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU) M cuBLAS ... Triton Triton (+ LeakyReLU)
0 128.0 0.455111 ... 0.512000 0.512000 0 128.0 0.512000 ... 0.512000 0.512000
1 256.0 2.730667 ... 3.276800 2.978909 1 256.0 2.730667 ... 2.978909 2.978909
2 384.0 7.372800 ... 7.899428 7.899428 2 384.0 7.372800 ... 7.899428 7.899428
3 512.0 14.563555 ... 16.384000 16.384000 3 512.0 14.563555 ... 15.420235 15.420235
4 640.0 22.260869 ... 24.380953 24.380953 4 640.0 22.260869 ... 24.380953 23.272727
5 768.0 32.768000 ... 34.028308 34.028308 5 768.0 32.768000 ... 34.028308 34.028308
6 896.0 39.025776 ... 40.140799 35.150663 6 896.0 39.025776 ... 39.025776 37.971025
7 1024.0 49.932191 ... 52.428801 52.428801 7 1024.0 49.932191 ... 52.428801 52.428801
8 1152.0 44.566925 ... 46.656000 46.656000 8 1152.0 44.566925 ... 46.656000 46.656000
9 1280.0 51.200001 ... 56.109587 56.109587 9 1280.0 51.200001 ... 56.888887 56.109587
10 1408.0 64.138541 ... 64.902096 64.138541 10 1408.0 64.138541 ... 64.902096 58.016903
11 1536.0 80.430545 ... 76.106321 75.296679 11 1536.0 79.526831 ... 76.106321 75.296679
12 1664.0 62.929456 ... 62.061463 62.061463 12 1664.0 62.929456 ... 62.492442 62.492442
13 1792.0 72.983276 ... 69.810085 69.379162 13 1792.0 72.983276 ... 69.810085 69.810085
14 1920.0 69.120002 ... 70.892307 69.120002 14 1920.0 66.782607 ... 69.467336 69.120002
15 2048.0 73.584279 ... 74.898285 74.565406 15 2048.0 73.262953 ... 74.898285 74.565406
16 2176.0 83.155572 ... 80.817862 79.855747 16 2176.0 82.473969 ... 80.173899 77.398646
17 2304.0 68.446623 ... 72.828879 73.275679 17 2304.0 68.446623 ... 73.501144 73.501144
18 2432.0 71.305746 ... 82.388456 81.908060 18 2432.0 71.305746 ... 81.908060 81.908060
19 2560.0 78.019048 ... 77.283019 75.676673 19 2560.0 77.649287 ... 76.740048 75.328737
20 2688.0 83.552988 ... 83.552988 83.922689 20 2688.0 83.552988 ... 82.823267 81.928846
21 2816.0 81.827785 ... 77.330158 79.154642 21 2816.0 84.035084 ... 78.021838 79.733474
22 2944.0 81.166173 ... 77.747321 79.483304 22 2944.0 81.431424 ... 79.230573 77.990663
23 3072.0 79.863336 ... 82.661468 82.420822 23 3072.0 82.420822 ... 83.146995 80.774758
24 3200.0 83.660130 ... 90.395483 85.906037 24 3200.0 84.321474 ... 86.137280 90.140846
25 3328.0 83.226931 ... 87.368079 83.613586 25 3328.0 83.226931 ... 81.438120 86.946008
26 3456.0 80.220468 ... 81.600781 83.459178 26 3456.0 81.932484 ... 81.189898 85.133652
27 3584.0 87.466332 ... 92.887804 84.983685 27 3584.0 88.238857 ... 87.979837 89.468054
28 3712.0 84.159518 ... 83.178475 83.666116 28 3712.0 85.455380 ... 82.084920 86.044224
29 3840.0 83.591840 ... 84.228485 85.663823 29 3840.0 83.591840 ... 84.809814 85.333335
30 3968.0 91.885495 ... 84.680037 84.154440 30 3968.0 90.859224 ... 86.911637 86.296981
31 4096.0 89.181212 ... 90.260743 90.200084 31 4096.0 92.309303 ... 90.504200 90.382307
[32 rows x 5 columns] [32 rows x 5 columns]
</pre></div> </pre></div>
</div> </div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 29.710 seconds)</p> <p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 17.805 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py"> <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container"> <div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p> <p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>

View File

@@ -174,7 +174,7 @@
<div class="section" id="computation-times"> <div class="section" id="computation-times">
<span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1> <span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1>
<p><strong>03:53.315</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p> <p><strong>03:41.443</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<table class="docutils align-default"> <table class="docutils align-default">
<colgroup> <colgroup>
<col style="width: 85%" /> <col style="width: 85%" />
@@ -183,15 +183,15 @@
</colgroup> </colgroup>
<tbody> <tbody>
<tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td> <tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
<td><p>02:29.710</p></td> <td><p>02:17.805</p></td>
<td><p>0.0 MB</p></td> <td><p>0.0 MB</p></td>
</tr> </tr>
<tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td> <tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
<td><p>01:12.618</p></td> <td><p>01:12.644</p></td>
<td><p>0.0 MB</p></td> <td><p>0.0 MB</p></td>
</tr> </tr>
<tr class="row-odd"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td> <tr class="row-odd"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
<td><p>00:10.987</p></td> <td><p>00:10.995</p></td>
<td><p>0.0 MB</p></td> <td><p>0.0 MB</p></td>
</tr> </tr>
</tbody> </tbody>

File diff suppressed because one or more lines are too long