[GH-PAGES] Updated website
This commit is contained in:
Philippe Tillet
@@ -1,4 +1,4 @@
|
||||
# Sphinx build info version 1
|
||||
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
|
||||
config: 6c093ecf6b8737c5bb8e2ea93b6f942c
|
||||
config: 8ae61200c8baa3f520f3987c5c5ea3f3
|
||||
tags: 645f666f9bcd5a90fca523b33c5a78b7
|
||||
|
||||
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
|
Before Width: | Height: | Size: 24 KiB After Width: | Height: | Size: 24 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 16 KiB After Width: | Height: | Size: 16 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 37 KiB After Width: | Height: | Size: 37 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 24 KiB After Width: | Height: | Size: 24 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 57 KiB After Width: | Height: | Size: 58 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 33 KiB After Width: | Height: | Size: 33 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 32 KiB After Width: | Height: | Size: 32 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 21 KiB After Width: | Height: | Size: 20 KiB |
@@ -237,7 +237,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
|
||||
3 32768.0 76.800002 76.800002
|
||||
4 65536.0 127.999995 127.999995
|
||||
5 131072.0 219.428568 219.428568
|
||||
6 262144.0 384.000001 384.000001
|
||||
6 262144.0 341.333321 384.000001
|
||||
7 524288.0 472.615390 472.615390
|
||||
8 1048576.0 614.400016 614.400016
|
||||
9 2097152.0 722.823517 722.823517
|
||||
@@ -254,7 +254,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
|
||||
|
||||
.. rst-class:: sphx-glr-timing
|
||||
|
||||
**Total running time of the script:** ( 1 minutes 37.033 seconds)
|
||||
**Total running time of the script:** ( 1 minutes 42.563 seconds)
|
||||
|
||||
|
||||
.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:
|
||||
|
||||
@@ -286,17 +286,17 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
|
||||
|
||||
softmax-performance:
|
||||
N Triton Torch (native) Torch (jit)
|
||||
0 256.0 546.133347 546.133347 190.511628
|
||||
1 384.0 585.142862 585.142862 151.703707
|
||||
2 512.0 655.360017 606.814814 154.566038
|
||||
0 256.0 512.000001 546.133347 188.321838
|
||||
1 384.0 614.400016 585.142862 153.600004
|
||||
2 512.0 655.360017 585.142849 154.566038
|
||||
3 640.0 682.666684 640.000002 160.000000
|
||||
4 768.0 722.823517 664.216187 162.754967
|
||||
4 768.0 722.823517 664.216187 163.839992
|
||||
.. ... ... ... ...
|
||||
93 12160.0 812.359066 405.755985 198.834951
|
||||
94 12288.0 814.111783 415.661740 199.096718
|
||||
95 12416.0 812.498981 411.296057 198.854847
|
||||
96 12544.0 812.566838 412.971190 199.012395
|
||||
97 12672.0 812.633240 412.097543 199.069228
|
||||
93 12160.0 812.359066 406.603966 199.038365
|
||||
94 12288.0 814.111783 416.101597 199.298541
|
||||
95 12416.0 814.163950 413.006241 198.854847
|
||||
96 12544.0 812.566838 412.971190 199.111113
|
||||
97 12672.0 812.633240 412.516771 199.167004
|
||||
|
||||
[98 rows x 4 columns]
|
||||
|
||||
@@ -314,7 +314,7 @@ In the above plot, we can see that:
|
||||
|
||||
.. rst-class:: sphx-glr-timing
|
||||
|
||||
**Total running time of the script:** ( 3 minutes 22.710 seconds)
|
||||
**Total running time of the script:** ( 3 minutes 22.469 seconds)
|
||||
|
||||
|
||||
.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:
|
||||
|
||||
@@ -462,37 +462,37 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
|
||||
|
||||
matmul-performance:
|
||||
M cuBLAS ... Triton Triton (+ LeakyReLU)
|
||||
0 256.0 2.730667 ... 3.276800 2.978909
|
||||
1 384.0 7.372800 ... 8.507077 8.507077
|
||||
0 256.0 2.730667 ... 2.978909 2.978909
|
||||
1 384.0 7.372800 ... 8.507077 7.899428
|
||||
2 512.0 14.563555 ... 16.384000 16.384000
|
||||
3 640.0 22.260869 ... 24.380953 24.380953
|
||||
4 768.0 32.768000 ... 34.028308 34.028308
|
||||
5 896.0 37.971025 ... 40.140799 39.025776
|
||||
6 1024.0 51.150050 ... 52.428801 52.428801
|
||||
5 896.0 39.025776 ... 40.140799 39.025776
|
||||
6 1024.0 49.932191 ... 53.773130 52.428801
|
||||
7 1152.0 45.242181 ... 46.656000 46.656000
|
||||
8 1280.0 51.200001 ... 56.888887 56.888887
|
||||
9 1408.0 64.138541 ... 67.305878 67.305878
|
||||
10 1536.0 80.430545 ... 79.526831 79.526831
|
||||
11 1664.0 63.372618 ... 62.492442 62.061463
|
||||
12 1792.0 72.983276 ... 72.512412 72.047592
|
||||
13 1920.0 69.120002 ... 70.172588 70.172588
|
||||
8 1280.0 51.200001 ... 56.888887 56.109587
|
||||
9 1408.0 64.138541 ... 67.305878 66.485074
|
||||
10 1536.0 80.430545 ... 79.526831 78.643199
|
||||
11 1664.0 62.929456 ... 62.061463 62.061463
|
||||
12 1792.0 72.512412 ... 71.588687 71.588687
|
||||
13 1920.0 68.776119 ... 70.172588 70.530615
|
||||
14 2048.0 73.908442 ... 77.314362 76.959706
|
||||
15 2176.0 83.500614 ... 86.367588 85.632545
|
||||
16 2304.0 68.251065 ... 76.809875 76.563695
|
||||
15 2176.0 83.155572 ... 86.367588 85.269692
|
||||
16 2304.0 68.446623 ... 76.809875 76.563695
|
||||
17 2432.0 71.305746 ... 74.918570 84.877538
|
||||
18 2560.0 77.833728 ... 81.512437 80.709358
|
||||
19 2688.0 83.369354 ... 89.888756 90.102270
|
||||
20 2816.0 79.733474 ... 82.759409 82.602666
|
||||
21 2944.0 81.698415 ... 82.373605 79.610276
|
||||
22 3072.0 82.540970 ... 88.335577 88.060814
|
||||
23 3200.0 83.660130 ... 95.238096 95.096582
|
||||
24 3328.0 83.130825 ... 84.101981 84.596116
|
||||
25 3456.0 79.430113 ... 84.775569 88.304015
|
||||
26 3584.0 87.296493 ... 98.483450 92.600816
|
||||
27 3712.0 84.946722 ... 86.267139 82.084920
|
||||
28 3840.0 84.744825 ... 92.159996 84.162386
|
||||
29 3968.0 92.512459 ... 83.406657 91.266964
|
||||
30 4096.0 86.619150 ... 86.064590 90.443212
|
||||
18 2560.0 77.833728 ... 81.310171 81.108913
|
||||
19 2688.0 83.552988 ... 90.102270 88.732296
|
||||
20 2816.0 82.602666 ... 83.712490 82.759409
|
||||
21 2944.0 81.967162 ... 82.578347 82.646820
|
||||
22 3072.0 82.062468 ... 87.651868 86.579673
|
||||
23 3200.0 84.544253 ... 89.887639 94.674553
|
||||
24 3328.0 83.226931 ... 81.346098 83.710812
|
||||
25 3456.0 82.688790 ... 90.180725 91.097818
|
||||
26 3584.0 85.430303 ... 92.505546 97.522120
|
||||
27 3712.0 85.528545 ... 85.672957 87.552452
|
||||
28 3840.0 84.292684 ... 87.148936 91.022218
|
||||
29 3968.0 86.973584 ... 90.656713 84.856701
|
||||
30 4096.0 93.531519 ... 83.416859 87.267706
|
||||
|
||||
[31 rows x 5 columns]
|
||||
|
||||
@@ -502,7 +502,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
|
||||
|
||||
.. rst-class:: sphx-glr-timing
|
||||
|
||||
**Total running time of the script:** ( 5 minutes 23.067 seconds)
|
||||
**Total running time of the script:** ( 5 minutes 27.557 seconds)
|
||||
|
||||
|
||||
.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:
|
||||
|
||||
@@ -238,7 +238,7 @@ References
|
||||
|
||||
.. rst-class:: sphx-glr-timing
|
||||
|
||||
**Total running time of the script:** ( 0 minutes 0.012 seconds)
|
||||
**Total running time of the script:** ( 0 minutes 0.010 seconds)
|
||||
|
||||
|
||||
.. _sphx_glr_download_getting-started_tutorials_04-low-memory-dropout.py:
|
||||
|
||||
@@ -38,36 +38,36 @@ Layer Normalization
|
||||
|
||||
layer-norm-backward:
|
||||
N Triton Torch Apex
|
||||
0 1024.0 311.088617 97.912354 303.407414
|
||||
1 1536.0 351.085717 135.032961 341.333333
|
||||
2 2048.0 427.408686 161.154101 329.879196
|
||||
3 2560.0 465.454542 181.238943 332.108113
|
||||
4 3072.0 519.211251 192.501302 321.956335
|
||||
5 3584.0 554.941930 208.776702 311.652167
|
||||
6 4096.0 571.534884 220.412561 299.707322
|
||||
7 4608.0 500.416301 233.316456 286.507772
|
||||
8 5120.0 527.381977 241.889751 282.482762
|
||||
9 5632.0 542.843364 243.107920 291.310338
|
||||
10 6144.0 544.118087 249.081070 286.879370
|
||||
11 6656.0 528.953642 256.000009 286.279570
|
||||
12 7168.0 508.970395 259.867079 285.767449
|
||||
13 7680.0 483.779539 263.314295 279.272719
|
||||
14 8192.0 461.521112 267.493874 284.939124
|
||||
15 8704.0 416.127506 267.815384 285.377055
|
||||
16 9216.0 431.157889 271.724806 289.129410
|
||||
17 9728.0 438.033784 280.615388 289.308559
|
||||
18 10240.0 447.650282 286.767793 290.153487
|
||||
19 10752.0 430.797982 246.699797 290.267711
|
||||
20 11264.0 429.104745 245.760001 287.285864
|
||||
21 11776.0 423.089806 249.667843 288.981596
|
||||
22 12288.0 418.909088 254.673582 294.911986
|
||||
23 12800.0 415.696898 253.256381 289.538159
|
||||
24 13312.0 412.242569 252.759501 290.707920
|
||||
25 13824.0 405.594132 257.190689 292.313649
|
||||
26 14336.0 398.683664 254.485198 286.959121
|
||||
27 14848.0 385.245405 257.479779 289.717061
|
||||
28 15360.0 376.547496 258.151252 287.326580
|
||||
29 15872.0 368.402336 261.986243 289.899545
|
||||
0 1024.0 311.088617 99.497980 307.200008
|
||||
1 1536.0 351.085717 135.032961 344.523365
|
||||
2 2048.0 427.408686 159.584422 323.368435
|
||||
3 2560.0 461.954908 182.857144 326.808501
|
||||
4 3072.0 515.580429 192.501302 316.429186
|
||||
5 3584.0 554.941930 208.271186 308.301075
|
||||
6 4096.0 568.231237 219.919464 297.890900
|
||||
7 4608.0 500.416301 233.316456 291.031570
|
||||
8 5120.0 527.381977 240.941184 285.104413
|
||||
9 5632.0 538.517949 243.985547 289.438969
|
||||
10 6144.0 546.133354 249.081070 286.322318
|
||||
11 6656.0 525.473708 256.000009 285.767438
|
||||
12 7168.0 512.000004 259.475119 284.821192
|
||||
13 7680.0 485.052616 263.690977 277.172933
|
||||
14 8192.0 463.698115 266.406514 284.939124
|
||||
15 8704.0 417.791980 267.472468 285.767450
|
||||
16 9216.0 431.157889 272.059034 289.507855
|
||||
17 9728.0 439.683593 280.278512 290.027323
|
||||
18 10240.0 446.836366 287.102804 290.496460
|
||||
19 10752.0 430.797982 246.229020 290.594591
|
||||
20 11264.0 429.786952 246.882202 288.204696
|
||||
21 11776.0 422.457417 248.788725 287.804473
|
||||
22 12288.0 420.701865 254.453844 294.029924
|
||||
23 12800.0 416.260178 253.256381 287.910035
|
||||
24 13312.0 411.711355 252.161013 289.916513
|
||||
25 13824.0 406.588243 256.991469 292.313649
|
||||
26 14336.0 396.387109 254.673567 287.919661
|
||||
27 14848.0 383.380322 257.479779 289.246765
|
||||
28 15360.0 376.547496 258.332158 286.656296
|
||||
29 15872.0 366.982663 262.527914 290.562936
|
||||
|
||||
|
||||
|
||||
@@ -329,7 +329,7 @@ Layer Normalization
|
||||
|
||||
.. rst-class:: sphx-glr-timing
|
||||
|
||||
**Total running time of the script:** ( 2 minutes 9.504 seconds)
|
||||
**Total running time of the script:** ( 2 minutes 11.866 seconds)
|
||||
|
||||
|
||||
.. _sphx_glr_download_getting-started_tutorials_05-layer-norm.py:
|
||||
|
||||
@@ -5,16 +5,16 @@
|
||||
|
||||
Computation times
|
||||
=================
|
||||
**12:32.325** total execution time for **getting-started_tutorials** files:
|
||||
**12:44.465** total execution time for **getting-started_tutorials** files:
|
||||
|
||||
+---------------------------------------------------------------------------------------------------------+-----------+--------+
|
||||
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 05:23.067 | 0.0 MB |
|
||||
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 05:27.557 | 0.0 MB |
|
||||
+---------------------------------------------------------------------------------------------------------+-----------+--------+
|
||||
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 03:22.710 | 0.0 MB |
|
||||
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 03:22.469 | 0.0 MB |
|
||||
+---------------------------------------------------------------------------------------------------------+-----------+--------+
|
||||
| :ref:`sphx_glr_getting-started_tutorials_05-layer-norm.py` (``05-layer-norm.py``) | 02:09.504 | 0.0 MB |
|
||||
| :ref:`sphx_glr_getting-started_tutorials_05-layer-norm.py` (``05-layer-norm.py``) | 02:11.866 | 0.0 MB |
|
||||
+---------------------------------------------------------------------------------------------------------+-----------+--------+
|
||||
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 01:37.033 | 0.0 MB |
|
||||
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 01:42.563 | 0.0 MB |
|
||||
+---------------------------------------------------------------------------------------------------------+-----------+--------+
|
||||
| :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py` (``04-low-memory-dropout.py``) | 00:00.012 | 0.0 MB |
|
||||
| :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py` (``04-low-memory-dropout.py``) | 00:00.010 | 0.0 MB |
|
||||
+---------------------------------------------------------------------------------------------------------+-----------+--------+
|
||||
|
||||
@@ -327,7 +327,7 @@ for different problem sizes.</p>
|
||||
3 32768.0 76.800002 76.800002
|
||||
4 65536.0 127.999995 127.999995
|
||||
5 131072.0 219.428568 219.428568
|
||||
6 262144.0 384.000001 384.000001
|
||||
6 262144.0 341.333321 384.000001
|
||||
7 524288.0 472.615390 472.615390
|
||||
8 1048576.0 614.400016 614.400016
|
||||
9 2097152.0 722.823517 722.823517
|
||||
@@ -339,7 +339,7 @@ for different problem sizes.</p>
|
||||
15 134217728.0 849.737435 850.656574
|
||||
</pre></div>
|
||||
</div>
|
||||
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 37.033 seconds)</p>
|
||||
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 42.563 seconds)</p>
|
||||
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
|
||||
<div class="sphx-glr-download sphx-glr-download-python docutils container">
|
||||
<p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>
|
||||
|
||||
@@ -374,17 +374,17 @@ We will then compare its performance against (1) <code class="code docutils lite
|
||||
<p class="sphx-glr-script-out">Out:</p>
|
||||
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>softmax-performance:
|
||||
N Triton Torch (native) Torch (jit)
|
||||
0 256.0 546.133347 546.133347 190.511628
|
||||
1 384.0 585.142862 585.142862 151.703707
|
||||
2 512.0 655.360017 606.814814 154.566038
|
||||
0 256.0 512.000001 546.133347 188.321838
|
||||
1 384.0 614.400016 585.142862 153.600004
|
||||
2 512.0 655.360017 585.142849 154.566038
|
||||
3 640.0 682.666684 640.000002 160.000000
|
||||
4 768.0 722.823517 664.216187 162.754967
|
||||
4 768.0 722.823517 664.216187 163.839992
|
||||
.. ... ... ... ...
|
||||
93 12160.0 812.359066 405.755985 198.834951
|
||||
94 12288.0 814.111783 415.661740 199.096718
|
||||
95 12416.0 812.498981 411.296057 198.854847
|
||||
96 12544.0 812.566838 412.971190 199.012395
|
||||
97 12672.0 812.633240 412.097543 199.069228
|
||||
93 12160.0 812.359066 406.603966 199.038365
|
||||
94 12288.0 814.111783 416.101597 199.298541
|
||||
95 12416.0 814.163950 413.006241 198.854847
|
||||
96 12544.0 812.566838 412.971190 199.111113
|
||||
97 12672.0 812.633240 412.516771 199.167004
|
||||
|
||||
[98 rows x 4 columns]
|
||||
</pre></div>
|
||||
@@ -397,7 +397,7 @@ We will then compare its performance against (1) <code class="code docutils lite
|
||||
Note however that the PyTorch <cite>softmax</cite> operation is more general and will works on tensors of any shape.</p></li>
|
||||
</ul>
|
||||
</div></blockquote>
|
||||
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 3 minutes 22.710 seconds)</p>
|
||||
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 3 minutes 22.469 seconds)</p>
|
||||
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
|
||||
<div class="sphx-glr-download sphx-glr-download-python docutils container">
|
||||
<p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>
|
||||
|
||||
@@ -568,42 +568,42 @@ torch_output=tensor([[ 1.1045, -36.9688, 31.4688, ..., -11.3906, 24.4531, -3
|
||||
<p class="sphx-glr-script-out">Out:</p>
|
||||
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance:
|
||||
M cuBLAS ... Triton Triton (+ LeakyReLU)
|
||||
0 256.0 2.730667 ... 3.276800 2.978909
|
||||
1 384.0 7.372800 ... 8.507077 8.507077
|
||||
0 256.0 2.730667 ... 2.978909 2.978909
|
||||
1 384.0 7.372800 ... 8.507077 7.899428
|
||||
2 512.0 14.563555 ... 16.384000 16.384000
|
||||
3 640.0 22.260869 ... 24.380953 24.380953
|
||||
4 768.0 32.768000 ... 34.028308 34.028308
|
||||
5 896.0 37.971025 ... 40.140799 39.025776
|
||||
6 1024.0 51.150050 ... 52.428801 52.428801
|
||||
5 896.0 39.025776 ... 40.140799 39.025776
|
||||
6 1024.0 49.932191 ... 53.773130 52.428801
|
||||
7 1152.0 45.242181 ... 46.656000 46.656000
|
||||
8 1280.0 51.200001 ... 56.888887 56.888887
|
||||
9 1408.0 64.138541 ... 67.305878 67.305878
|
||||
10 1536.0 80.430545 ... 79.526831 79.526831
|
||||
11 1664.0 63.372618 ... 62.492442 62.061463
|
||||
12 1792.0 72.983276 ... 72.512412 72.047592
|
||||
13 1920.0 69.120002 ... 70.172588 70.172588
|
||||
8 1280.0 51.200001 ... 56.888887 56.109587
|
||||
9 1408.0 64.138541 ... 67.305878 66.485074
|
||||
10 1536.0 80.430545 ... 79.526831 78.643199
|
||||
11 1664.0 62.929456 ... 62.061463 62.061463
|
||||
12 1792.0 72.512412 ... 71.588687 71.588687
|
||||
13 1920.0 68.776119 ... 70.172588 70.530615
|
||||
14 2048.0 73.908442 ... 77.314362 76.959706
|
||||
15 2176.0 83.500614 ... 86.367588 85.632545
|
||||
16 2304.0 68.251065 ... 76.809875 76.563695
|
||||
15 2176.0 83.155572 ... 86.367588 85.269692
|
||||
16 2304.0 68.446623 ... 76.809875 76.563695
|
||||
17 2432.0 71.305746 ... 74.918570 84.877538
|
||||
18 2560.0 77.833728 ... 81.512437 80.709358
|
||||
19 2688.0 83.369354 ... 89.888756 90.102270
|
||||
20 2816.0 79.733474 ... 82.759409 82.602666
|
||||
21 2944.0 81.698415 ... 82.373605 79.610276
|
||||
22 3072.0 82.540970 ... 88.335577 88.060814
|
||||
23 3200.0 83.660130 ... 95.238096 95.096582
|
||||
24 3328.0 83.130825 ... 84.101981 84.596116
|
||||
25 3456.0 79.430113 ... 84.775569 88.304015
|
||||
26 3584.0 87.296493 ... 98.483450 92.600816
|
||||
27 3712.0 84.946722 ... 86.267139 82.084920
|
||||
28 3840.0 84.744825 ... 92.159996 84.162386
|
||||
29 3968.0 92.512459 ... 83.406657 91.266964
|
||||
30 4096.0 86.619150 ... 86.064590 90.443212
|
||||
18 2560.0 77.833728 ... 81.310171 81.108913
|
||||
19 2688.0 83.552988 ... 90.102270 88.732296
|
||||
20 2816.0 82.602666 ... 83.712490 82.759409
|
||||
21 2944.0 81.967162 ... 82.578347 82.646820
|
||||
22 3072.0 82.062468 ... 87.651868 86.579673
|
||||
23 3200.0 84.544253 ... 89.887639 94.674553
|
||||
24 3328.0 83.226931 ... 81.346098 83.710812
|
||||
25 3456.0 82.688790 ... 90.180725 91.097818
|
||||
26 3584.0 85.430303 ... 92.505546 97.522120
|
||||
27 3712.0 85.528545 ... 85.672957 87.552452
|
||||
28 3840.0 84.292684 ... 87.148936 91.022218
|
||||
29 3968.0 86.973584 ... 90.656713 84.856701
|
||||
30 4096.0 93.531519 ... 83.416859 87.267706
|
||||
|
||||
[31 rows x 5 columns]
|
||||
</pre></div>
|
||||
</div>
|
||||
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 5 minutes 23.067 seconds)</p>
|
||||
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 5 minutes 27.557 seconds)</p>
|
||||
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
|
||||
<div class="sphx-glr-download sphx-glr-download-python docutils container">
|
||||
<p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>
|
||||
|
||||
@@ -371,7 +371,7 @@ to explore the <cite>triton/language/random</cite> folder!</p>
|
||||
<dd><p>Nitish Srivastava and Geoffrey Hinton and Alex Krizhevsky and Ilya Sutskever and Ruslan Salakhutdinov, “Dropout: A Simple Way to Prevent Neural Networks from Overfitting”, JMLR 2014</p>
|
||||
</dd>
|
||||
</dl>
|
||||
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 0.012 seconds)</p>
|
||||
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 0.010 seconds)</p>
|
||||
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-04-low-memory-dropout-py">
|
||||
<div class="sphx-glr-download sphx-glr-download-python docutils container">
|
||||
<p><a class="reference download internal" download="" href="../../_downloads/c9aed78977a4c05741d675a38dde3d7d/04-low-memory-dropout.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">04-low-memory-dropout.py</span></code></a></p>
|
||||
|
||||
@@ -194,36 +194,36 @@ to download the full example code</p>
|
||||
<p class="sphx-glr-script-out">Out:</p>
|
||||
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>layer-norm-backward:
|
||||
N Triton Torch Apex
|
||||
0 1024.0 311.088617 97.912354 303.407414
|
||||
1 1536.0 351.085717 135.032961 341.333333
|
||||
2 2048.0 427.408686 161.154101 329.879196
|
||||
3 2560.0 465.454542 181.238943 332.108113
|
||||
4 3072.0 519.211251 192.501302 321.956335
|
||||
5 3584.0 554.941930 208.776702 311.652167
|
||||
6 4096.0 571.534884 220.412561 299.707322
|
||||
7 4608.0 500.416301 233.316456 286.507772
|
||||
8 5120.0 527.381977 241.889751 282.482762
|
||||
9 5632.0 542.843364 243.107920 291.310338
|
||||
10 6144.0 544.118087 249.081070 286.879370
|
||||
11 6656.0 528.953642 256.000009 286.279570
|
||||
12 7168.0 508.970395 259.867079 285.767449
|
||||
13 7680.0 483.779539 263.314295 279.272719
|
||||
14 8192.0 461.521112 267.493874 284.939124
|
||||
15 8704.0 416.127506 267.815384 285.377055
|
||||
16 9216.0 431.157889 271.724806 289.129410
|
||||
17 9728.0 438.033784 280.615388 289.308559
|
||||
18 10240.0 447.650282 286.767793 290.153487
|
||||
19 10752.0 430.797982 246.699797 290.267711
|
||||
20 11264.0 429.104745 245.760001 287.285864
|
||||
21 11776.0 423.089806 249.667843 288.981596
|
||||
22 12288.0 418.909088 254.673582 294.911986
|
||||
23 12800.0 415.696898 253.256381 289.538159
|
||||
24 13312.0 412.242569 252.759501 290.707920
|
||||
25 13824.0 405.594132 257.190689 292.313649
|
||||
26 14336.0 398.683664 254.485198 286.959121
|
||||
27 14848.0 385.245405 257.479779 289.717061
|
||||
28 15360.0 376.547496 258.151252 287.326580
|
||||
29 15872.0 368.402336 261.986243 289.899545
|
||||
0 1024.0 311.088617 99.497980 307.200008
|
||||
1 1536.0 351.085717 135.032961 344.523365
|
||||
2 2048.0 427.408686 159.584422 323.368435
|
||||
3 2560.0 461.954908 182.857144 326.808501
|
||||
4 3072.0 515.580429 192.501302 316.429186
|
||||
5 3584.0 554.941930 208.271186 308.301075
|
||||
6 4096.0 568.231237 219.919464 297.890900
|
||||
7 4608.0 500.416301 233.316456 291.031570
|
||||
8 5120.0 527.381977 240.941184 285.104413
|
||||
9 5632.0 538.517949 243.985547 289.438969
|
||||
10 6144.0 546.133354 249.081070 286.322318
|
||||
11 6656.0 525.473708 256.000009 285.767438
|
||||
12 7168.0 512.000004 259.475119 284.821192
|
||||
13 7680.0 485.052616 263.690977 277.172933
|
||||
14 8192.0 463.698115 266.406514 284.939124
|
||||
15 8704.0 417.791980 267.472468 285.767450
|
||||
16 9216.0 431.157889 272.059034 289.507855
|
||||
17 9728.0 439.683593 280.278512 290.027323
|
||||
18 10240.0 446.836366 287.102804 290.496460
|
||||
19 10752.0 430.797982 246.229020 290.594591
|
||||
20 11264.0 429.786952 246.882202 288.204696
|
||||
21 11776.0 422.457417 248.788725 287.804473
|
||||
22 12288.0 420.701865 254.453844 294.029924
|
||||
23 12800.0 416.260178 253.256381 287.910035
|
||||
24 13312.0 411.711355 252.161013 289.916513
|
||||
25 13824.0 406.588243 256.991469 292.313649
|
||||
26 14336.0 396.387109 254.673567 287.919661
|
||||
27 14848.0 383.380322 257.479779 289.246765
|
||||
28 15360.0 376.547496 258.332158 286.656296
|
||||
29 15872.0 366.982663 262.527914 290.562936
|
||||
</pre></div>
|
||||
</div>
|
||||
<div class="line-block">
|
||||
@@ -477,7 +477,7 @@ to download the full example code</p>
|
||||
<span class="n">bench_layer_norm</span><span class="o">.</span><span class="n">run</span><span class="p">(</span><span class="n">save_path</span><span class="o">=</span><span class="s1">'.'</span><span class="p">,</span> <span class="n">print_data</span><span class="o">=</span><span class="kc">True</span><span class="p">)</span>
|
||||
</pre></div>
|
||||
</div>
|
||||
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 9.504 seconds)</p>
|
||||
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 11.866 seconds)</p>
|
||||
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-05-layer-norm-py">
|
||||
<div class="sphx-glr-download sphx-glr-download-python docutils container">
|
||||
<p><a class="reference download internal" download="" href="../../_downloads/935c0dd0fbeb4b2e69588471cbb2d4b2/05-layer-norm.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">05-layer-norm.py</span></code></a></p>
|
||||
|
||||
@@ -174,7 +174,7 @@
|
||||
|
||||
<div class="section" id="computation-times">
|
||||
<span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline">¶</a></h1>
|
||||
<p><strong>12:32.325</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
|
||||
<p><strong>12:44.465</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
|
||||
<table class="docutils align-default">
|
||||
<colgroup>
|
||||
<col style="width: 85%" />
|
||||
@@ -183,23 +183,23 @@
|
||||
</colgroup>
|
||||
<tbody>
|
||||
<tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
|
||||
<td><p>05:23.067</p></td>
|
||||
<td><p>05:27.557</p></td>
|
||||
<td><p>0.0 MB</p></td>
|
||||
</tr>
|
||||
<tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
|
||||
<td><p>03:22.710</p></td>
|
||||
<td><p>03:22.469</p></td>
|
||||
<td><p>0.0 MB</p></td>
|
||||
</tr>
|
||||
<tr class="row-odd"><td><p><a class="reference internal" href="05-layer-norm.html#sphx-glr-getting-started-tutorials-05-layer-norm-py"><span class="std std-ref">Layer Normalization</span></a> (<code class="docutils literal notranslate"><span class="pre">05-layer-norm.py</span></code>)</p></td>
|
||||
<td><p>02:09.504</p></td>
|
||||
<td><p>02:11.866</p></td>
|
||||
<td><p>0.0 MB</p></td>
|
||||
</tr>
|
||||
<tr class="row-even"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
|
||||
<td><p>01:37.033</p></td>
|
||||
<td><p>01:42.563</p></td>
|
||||
<td><p>0.0 MB</p></td>
|
||||
</tr>
|
||||
<tr class="row-odd"><td><p><a class="reference internal" href="04-low-memory-dropout.html#sphx-glr-getting-started-tutorials-04-low-memory-dropout-py"><span class="std std-ref">Low-Memory Dropout</span></a> (<code class="docutils literal notranslate"><span class="pre">04-low-memory-dropout.py</span></code>)</p></td>
|
||||
<td><p>00:00.012</p></td>
|
||||
<td><p>00:00.010</p></td>
|
||||
<td><p>0.0 MB</p></td>
|
||||
</tr>
|
||||
</tbody>
|
||||
|
||||
File diff suppressed because one or more lines are too long
Reference in New Issue
Block a user