[GH-PAGES] Updated website

This commit is contained in:
Philippe Tillet
2022-05-02 00:42:39 +00:00
parent 0bce260523
commit 567aa8d4fc
158 changed files with 308 additions and 308 deletions

View File

@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
config: 2733d834a878ced23a6c2f6f4c64be8c
config: 29a6392189b919d314768a8cb78a5eab
tags: 645f666f9bcd5a90fca523b33c5a78b7

Binary file not shown.

Binary file not shown.

Binary file not shown.

Before

Width:  |  Height:  |  Size: 24 KiB

After

Width:  |  Height:  |  Size: 23 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 15 KiB

After

Width:  |  Height:  |  Size: 15 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 36 KiB

After

Width:  |  Height:  |  Size: 37 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 23 KiB

After

Width:  |  Height:  |  Size: 23 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 57 KiB

After

Width:  |  Height:  |  Size: 56 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 33 KiB

After

Width:  |  Height:  |  Size: 32 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 32 KiB

After

Width:  |  Height:  |  Size: 33 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 21 KiB

After

Width:  |  Height:  |  Size: 21 KiB

View File

@@ -234,7 +234,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
size Triton Torch
0 4096.0 9.600000 9.600000
1 8192.0 19.200000 19.200000
2 16384.0 31.999999 31.999999
2 16384.0 38.400001 38.400001
3 32768.0 76.800002 76.800002
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
@@ -255,7 +255,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 1 minutes 40.152 seconds)
**Total running time of the script:** ( 1 minutes 40.796 seconds)
.. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:

View File

@@ -278,17 +278,17 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
softmax-performance:
N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 558.545450 151.703707
0 256.0 512.000001 512.000001 186.181817
1 384.0 585.142862 585.142862 151.703707
2 512.0 655.360017 606.814814 154.566038
3 640.0 682.666684 640.000002 158.759699
4 768.0 722.823517 664.216187 163.839992
3 640.0 682.666684 640.000002 160.000000
4 768.0 722.823517 664.216187 162.754967
.. ... ... ... ...
93 12160.0 814.058574 405.755985 198.631953
94 12288.0 814.111783 415.661740 198.895304
95 12416.0 814.163950 412.149375 198.556711
96 12544.0 814.214963 412.971190 198.716830
97 12672.0 814.265046 411.679167 198.873965
93 12160.0 814.058574 405.755985 198.834951
94 12288.0 814.111783 415.222812 199.096718
95 12416.0 814.163950 411.722274 198.854847
96 12544.0 814.214963 412.546756 198.913776
97 12672.0 814.265046 411.679167 199.069228
[98 rows x 4 columns]
@@ -306,7 +306,7 @@ In the above plot, we can see that:
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 3 minutes 27.921 seconds)
**Total running time of the script:** ( 3 minutes 19.085 seconds)
.. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:

View File

@@ -458,37 +458,37 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 256.0 2.978909 ... 3.276800 2.978909
1 384.0 7.372800 ... 7.899428 8.507077
2 512.0 14.563555 ... 15.420235 16.384000
0 256.0 2.730667 ... 3.276800 2.978909
1 384.0 7.372800 ... 8.507077 8.507077
2 512.0 14.563555 ... 15.420235 15.420235
3 640.0 22.260869 ... 24.380953 24.380953
4 768.0 32.768000 ... 35.389441 34.028308
5 896.0 37.971025 ... 41.321411 39.025776
6 1024.0 49.932191 ... 53.773130 53.773130
4 768.0 32.768000 ... 34.028308 34.028308
5 896.0 37.971025 ... 41.321411 40.140799
6 1024.0 49.932191 ... 53.773130 52.428801
7 1152.0 45.242181 ... 48.161033 47.396572
8 1280.0 51.200001 ... 57.690139 57.690139
9 1408.0 64.138541 ... 69.009825 68.147202
9 1408.0 64.138541 ... 68.147202 68.147202
10 1536.0 80.430545 ... 80.430545 80.430545
11 1664.0 63.372618 ... 63.372618 62.929456
11 1664.0 62.929456 ... 63.372618 62.929456
12 1792.0 72.983276 ... 63.499573 63.142831
13 1920.0 68.776119 ... 71.257735 70.892307
13 1920.0 68.776119 ... 70.892307 70.892307
14 2048.0 73.584279 ... 78.398206 78.033565
15 2176.0 83.155572 ... 87.115360 86.739860
16 2304.0 68.251065 ... 78.064941 77.558029
16 2304.0 68.251065 ... 77.810656 77.558029
17 2432.0 71.305746 ... 75.726318 75.522751
18 2560.0 77.833728 ... 82.539044 82.331658
19 2688.0 84.108772 ... 91.185232 90.966561
20 2816.0 80.469019 ... 83.552120 84.523664
21 2944.0 81.832567 ... 84.324925 83.758038
22 3072.0 81.589488 ... 87.246694 89.451983
23 3200.0 85.106381 ... 96.385543 95.952022
24 3328.0 83.905938 ... 85.908470 86.113988
25 3456.0 82.604067 ... 85.043848 89.480098
26 3584.0 84.111686 ... 92.410473 94.747514
27 3712.0 85.675250 ... 85.896254 88.404730
28 3840.0 81.138664 ... 88.261772 91.701494
29 3968.0 87.976885 ... 92.477403 85.811488
30 4096.0 93.401342 ... 84.733417 86.872315
18 2560.0 77.833728 ... 81.715711 81.920002
19 2688.0 83.737433 ... 90.966561 90.316801
20 2816.0 84.035084 ... 83.552120 83.873477
21 2944.0 82.509987 ... 83.899046 84.040530
22 3072.0 81.589488 ... 86.184329 89.735509
23 3200.0 84.993363 ... 96.240602 96.240602
24 3328.0 83.226931 ... 85.806075 84.895397
25 3456.0 82.604067 ... 84.068369 88.692595
26 3584.0 87.211821 ... 100.017124 100.351999
27 3712.0 85.091436 ... 89.513749 87.094458
28 3840.0 84.228485 ... 92.390975 85.531326
29 3968.0 91.954739 ... 85.034103 91.540836
30 4096.0 87.495257 ... 89.597949 93.336389
[31 rows x 5 columns]
@@ -498,7 +498,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 6 minutes 55.944 seconds)
**Total running time of the script:** ( 6 minutes 7.559 seconds)
.. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:

View File

@@ -240,7 +240,7 @@ References
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 0 minutes 0.323 seconds)
**Total running time of the script:** ( 0 minutes 0.012 seconds)
.. _sphx_glr_download_getting-started_tutorials_04-low-memory-dropout.py:

View File

@@ -38,36 +38,36 @@ Layer Normalization
layer-norm-backward:
N Triton Torch Apex
0 1024.0 361.411758 97.912354 303.407414
1 1536.0 405.098894 134.540150 341.333333
2 2048.0 496.484863 161.154101 323.368435
3 2560.0 465.454542 181.238943 326.808501
4 3072.0 519.211251 192.501302 321.956335
5 3584.0 558.545477 208.271186 311.652167
6 4096.0 561.737163 220.907859 297.890900
7 4608.0 502.690905 232.825259 287.251954
8 5120.0 525.128191 242.366855 287.102804
9 5632.0 540.671974 243.107920 289.438969
10 6144.0 546.133354 248.661056 286.879370
11 6656.0 527.207907 256.000009 285.257135
12 7168.0 503.017523 260.260201 284.821192
13 7680.0 483.779539 262.938666 280.121579
14 8192.0 463.698115 266.406514 284.526763
15 8704.0 414.476194 267.472468 284.987724
16 9216.0 428.651187 271.724806 287.999990
17 9728.0 436.396262 280.278512 290.027323
18 10240.0 446.025405 286.433562 290.153487
19 10752.0 428.651173 246.935876 290.267711
20 11264.0 426.397479 245.536784 286.980888
21 11776.0 421.198220 249.888595 288.981596
22 12288.0 416.542386 254.673582 294.617366
23 12800.0 410.695192 254.094291 288.180121
24 13312.0 409.075539 253.360814 290.443638
25 13824.0 405.098897 257.390218 292.056329
26 14336.0 394.116833 254.862216 286.959121
27 14848.0 385.662341 257.852379 289.952797
28 15360.0 380.433442 257.970599 286.433562
29 15872.0 370.552519 261.626369 290.341468
0 1024.0 361.411758 99.902435 315.076934
1 1536.0 405.098894 133.083026 344.523365
2 2048.0 496.484863 158.554837 334.367350
3 2560.0 461.954908 182.857144 330.322572
4 3072.0 519.211251 191.501303 320.556515
5 3584.0 554.941930 208.271186 309.410081
6 4096.0 564.965515 220.412561 298.796351
7 4608.0 502.690905 231.849059 286.507772
8 5120.0 527.381977 244.294240 286.433562
9 5632.0 542.843364 244.426754 292.571431
10 6144.0 550.208948 251.202731 288.000001
11 6656.0 534.260858 256.000009 286.793541
12 7168.0 513.528374 253.734520 277.470965
13 7680.0 488.912481 266.743841 284.884090
14 8192.0 468.114289 258.694729 278.087683
15 8704.0 415.300208 267.472468 286.158893
16 9216.0 429.483477 273.066667 289.129410
17 9728.0 438.857162 279.942444 289.308559
18 10240.0 444.412281 287.102804 290.153487
19 10752.0 427.940303 246.935876 290.104546
20 11264.0 429.104745 246.432094 287.897767
21 11776.0 421.198220 249.888595 289.573776
22 12288.0 417.131525 254.673582 294.323369
23 12800.0 411.244989 253.884294 290.084977
24 13312.0 409.599999 252.959629 289.391298
25 13824.0 405.594132 256.991469 292.056329
26 14336.0 395.475867 255.619613 288.402346
27 14848.0 385.245405 256.922861 288.544136
28 15360.0 380.041240 258.332158 288.450715
29 15872.0 372.000001 263.071829 290.341468
@@ -339,7 +339,7 @@ Layer Normalization
.. rst-class:: sphx-glr-timing
**Total running time of the script:** ( 2 minutes 14.484 seconds)
**Total running time of the script:** ( 2 minutes 13.781 seconds)
.. _sphx_glr_download_getting-started_tutorials_05-layer-norm.py:

View File

@@ -5,16 +5,16 @@
Computation times
=================
**14:18.825** total execution time for **getting-started_tutorials** files:
**13:21.234** total execution time for **getting-started_tutorials** files:
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 06:55.944 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 06:07.559 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 03:27.921 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``) | 03:19.085 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_05-layer-norm.py` (``05-layer-norm.py``) | 02:14.484 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_05-layer-norm.py` (``05-layer-norm.py``) | 02:13.781 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 01:40.152 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``) | 01:40.796 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+
| :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py` (``04-low-memory-dropout.py``) | 00:00.323 | 0.0 MB |
| :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py` (``04-low-memory-dropout.py``) | 00:00.012 | 0.0 MB |
+---------------------------------------------------------------------------------------------------------+-----------+--------+

View File

@@ -324,7 +324,7 @@ for different problem sizes.</p>
size Triton Torch
0 4096.0 9.600000 9.600000
1 8192.0 19.200000 19.200000
2 16384.0 31.999999 31.999999
2 16384.0 38.400001 38.400001
3 32768.0 76.800002 76.800002
4 65536.0 127.999995 127.999995
5 131072.0 219.428568 219.428568
@@ -340,7 +340,7 @@ for different problem sizes.</p>
15 134217728.0 849.737435 850.656574
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 40.152 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes 40.796 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>

View File

@@ -369,17 +369,17 @@ We will then compare its performance against (1) <code class="code docutils lite
<p class="sphx-glr-script-out">Out:</p>
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>softmax-performance:
N Triton Torch (native) Torch (jit)
0 256.0 512.000001 546.133347 186.181817
1 384.0 585.142862 558.545450 151.703707
0 256.0 512.000001 512.000001 186.181817
1 384.0 585.142862 585.142862 151.703707
2 512.0 655.360017 606.814814 154.566038
3 640.0 682.666684 640.000002 158.759699
4 768.0 722.823517 664.216187 163.839992
3 640.0 682.666684 640.000002 160.000000
4 768.0 722.823517 664.216187 162.754967
.. ... ... ... ...
93 12160.0 814.058574 405.755985 198.631953
94 12288.0 814.111783 415.661740 198.895304
95 12416.0 814.163950 412.149375 198.556711
96 12544.0 814.214963 412.971190 198.716830
97 12672.0 814.265046 411.679167 198.873965
93 12160.0 814.058574 405.755985 198.834951
94 12288.0 814.111783 415.222812 199.096718
95 12416.0 814.163950 411.722274 198.854847
96 12544.0 814.214963 412.546756 198.913776
97 12672.0 814.265046 411.679167 199.069228
[98 rows x 4 columns]
</pre></div>
@@ -392,7 +392,7 @@ We will then compare its performance against (1) <code class="code docutils lite
Note however that the PyTorch <cite>softmax</cite> operation is more general and will works on tensors of any shape.</p></li>
</ul>
</div></blockquote>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 3 minutes 27.921 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 3 minutes 19.085 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>

View File

@@ -564,42 +564,42 @@ torch_output=tensor([[ 1.1045, -36.9688, 31.4688, ..., -11.3906, 24.4531, -3
<p class="sphx-glr-script-out">Out:</p>
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance:
M cuBLAS ... Triton Triton (+ LeakyReLU)
0 256.0 2.978909 ... 3.276800 2.978909
1 384.0 7.372800 ... 7.899428 8.507077
2 512.0 14.563555 ... 15.420235 16.384000
0 256.0 2.730667 ... 3.276800 2.978909
1 384.0 7.372800 ... 8.507077 8.507077
2 512.0 14.563555 ... 15.420235 15.420235
3 640.0 22.260869 ... 24.380953 24.380953
4 768.0 32.768000 ... 35.389441 34.028308
5 896.0 37.971025 ... 41.321411 39.025776
6 1024.0 49.932191 ... 53.773130 53.773130
4 768.0 32.768000 ... 34.028308 34.028308
5 896.0 37.971025 ... 41.321411 40.140799
6 1024.0 49.932191 ... 53.773130 52.428801
7 1152.0 45.242181 ... 48.161033 47.396572
8 1280.0 51.200001 ... 57.690139 57.690139
9 1408.0 64.138541 ... 69.009825 68.147202
9 1408.0 64.138541 ... 68.147202 68.147202
10 1536.0 80.430545 ... 80.430545 80.430545
11 1664.0 63.372618 ... 63.372618 62.929456
11 1664.0 62.929456 ... 63.372618 62.929456
12 1792.0 72.983276 ... 63.499573 63.142831
13 1920.0 68.776119 ... 71.257735 70.892307
13 1920.0 68.776119 ... 70.892307 70.892307
14 2048.0 73.584279 ... 78.398206 78.033565
15 2176.0 83.155572 ... 87.115360 86.739860
16 2304.0 68.251065 ... 78.064941 77.558029
16 2304.0 68.251065 ... 77.810656 77.558029
17 2432.0 71.305746 ... 75.726318 75.522751
18 2560.0 77.833728 ... 82.539044 82.331658
19 2688.0 84.108772 ... 91.185232 90.966561
20 2816.0 80.469019 ... 83.552120 84.523664
21 2944.0 81.832567 ... 84.324925 83.758038
22 3072.0 81.589488 ... 87.246694 89.451983
23 3200.0 85.106381 ... 96.385543 95.952022
24 3328.0 83.905938 ... 85.908470 86.113988
25 3456.0 82.604067 ... 85.043848 89.480098
26 3584.0 84.111686 ... 92.410473 94.747514
27 3712.0 85.675250 ... 85.896254 88.404730
28 3840.0 81.138664 ... 88.261772 91.701494
29 3968.0 87.976885 ... 92.477403 85.811488
30 4096.0 93.401342 ... 84.733417 86.872315
18 2560.0 77.833728 ... 81.715711 81.920002
19 2688.0 83.737433 ... 90.966561 90.316801
20 2816.0 84.035084 ... 83.552120 83.873477
21 2944.0 82.509987 ... 83.899046 84.040530
22 3072.0 81.589488 ... 86.184329 89.735509
23 3200.0 84.993363 ... 96.240602 96.240602
24 3328.0 83.226931 ... 85.806075 84.895397
25 3456.0 82.604067 ... 84.068369 88.692595
26 3584.0 87.211821 ... 100.017124 100.351999
27 3712.0 85.091436 ... 89.513749 87.094458
28 3840.0 84.228485 ... 92.390975 85.531326
29 3968.0 91.954739 ... 85.034103 91.540836
30 4096.0 87.495257 ... 89.597949 93.336389
[31 rows x 5 columns]
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 6 minutes 55.944 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 6 minutes 7.559 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>

View File

@@ -372,7 +372,7 @@ to explore the <cite>triton/language/random</cite> folder!</p>
<dd><p>Nitish Srivastava and Geoffrey Hinton and Alex Krizhevsky and Ilya Sutskever and Ruslan Salakhutdinov, “Dropout: A Simple Way to Prevent Neural Networks from Overfitting”, JMLR 2014</p>
</dd>
</dl>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 0.323 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes 0.012 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-04-low-memory-dropout-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/c9aed78977a4c05741d675a38dde3d7d/04-low-memory-dropout.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">04-low-memory-dropout.py</span></code></a></p>

View File

@@ -194,36 +194,36 @@ to download the full example code</p>
<p class="sphx-glr-script-out">Out:</p>
<div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>layer-norm-backward:
N Triton Torch Apex
0 1024.0 361.411758 97.912354 303.407414
1 1536.0 405.098894 134.540150 341.333333
2 2048.0 496.484863 161.154101 323.368435
3 2560.0 465.454542 181.238943 326.808501
4 3072.0 519.211251 192.501302 321.956335
5 3584.0 558.545477 208.271186 311.652167
6 4096.0 561.737163 220.907859 297.890900
7 4608.0 502.690905 232.825259 287.251954
8 5120.0 525.128191 242.366855 287.102804
9 5632.0 540.671974 243.107920 289.438969
10 6144.0 546.133354 248.661056 286.879370
11 6656.0 527.207907 256.000009 285.257135
12 7168.0 503.017523 260.260201 284.821192
13 7680.0 483.779539 262.938666 280.121579
14 8192.0 463.698115 266.406514 284.526763
15 8704.0 414.476194 267.472468 284.987724
16 9216.0 428.651187 271.724806 287.999990
17 9728.0 436.396262 280.278512 290.027323
18 10240.0 446.025405 286.433562 290.153487
19 10752.0 428.651173 246.935876 290.267711
20 11264.0 426.397479 245.536784 286.980888
21 11776.0 421.198220 249.888595 288.981596
22 12288.0 416.542386 254.673582 294.617366
23 12800.0 410.695192 254.094291 288.180121
24 13312.0 409.075539 253.360814 290.443638
25 13824.0 405.098897 257.390218 292.056329
26 14336.0 394.116833 254.862216 286.959121
27 14848.0 385.662341 257.852379 289.952797
28 15360.0 380.433442 257.970599 286.433562
29 15872.0 370.552519 261.626369 290.341468
0 1024.0 361.411758 99.902435 315.076934
1 1536.0 405.098894 133.083026 344.523365
2 2048.0 496.484863 158.554837 334.367350
3 2560.0 461.954908 182.857144 330.322572
4 3072.0 519.211251 191.501303 320.556515
5 3584.0 554.941930 208.271186 309.410081
6 4096.0 564.965515 220.412561 298.796351
7 4608.0 502.690905 231.849059 286.507772
8 5120.0 527.381977 244.294240 286.433562
9 5632.0 542.843364 244.426754 292.571431
10 6144.0 550.208948 251.202731 288.000001
11 6656.0 534.260858 256.000009 286.793541
12 7168.0 513.528374 253.734520 277.470965
13 7680.0 488.912481 266.743841 284.884090
14 8192.0 468.114289 258.694729 278.087683
15 8704.0 415.300208 267.472468 286.158893
16 9216.0 429.483477 273.066667 289.129410
17 9728.0 438.857162 279.942444 289.308559
18 10240.0 444.412281 287.102804 290.153487
19 10752.0 427.940303 246.935876 290.104546
20 11264.0 429.104745 246.432094 287.897767
21 11776.0 421.198220 249.888595 289.573776
22 12288.0 417.131525 254.673582 294.323369
23 12800.0 411.244989 253.884294 290.084977
24 13312.0 409.599999 252.959629 289.391298
25 13824.0 405.594132 256.991469 292.056329
26 14336.0 395.475867 255.619613 288.402346
27 14848.0 385.245405 256.922861 288.544136
28 15360.0 380.041240 258.332158 288.450715
29 15872.0 372.000001 263.071829 290.341468
</pre></div>
</div>
<div class="line-block">
@@ -487,7 +487,7 @@ to download the full example code</p>
<span class="n">bench_layer_norm</span><span class="o">.</span><span class="n">run</span><span class="p">(</span><span class="n">save_path</span><span class="o">=</span><span class="s1">&#39;.&#39;</span><span class="p">,</span> <span class="n">print_data</span><span class="o">=</span><span class="kc">True</span><span class="p">)</span>
</pre></div>
</div>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 14.484 seconds)</p>
<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes 13.781 seconds)</p>
<div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-05-layer-norm-py">
<div class="sphx-glr-download sphx-glr-download-python docutils container">
<p><a class="reference download internal" download="" href="../../_downloads/935c0dd0fbeb4b2e69588471cbb2d4b2/05-layer-norm.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">05-layer-norm.py</span></code></a></p>

View File

@@ -174,7 +174,7 @@
<div class="section" id="computation-times">
<span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline"></a></h1>
<p><strong>14:18.825</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<p><strong>13:21.234</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
<table class="docutils align-default">
<colgroup>
<col style="width: 85%" />
@@ -183,23 +183,23 @@
</colgroup>
<tbody>
<tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
<td><p>06:55.944</p></td>
<td><p>06:07.559</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
<td><p>03:27.921</p></td>
<td><p>03:19.085</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-odd"><td><p><a class="reference internal" href="05-layer-norm.html#sphx-glr-getting-started-tutorials-05-layer-norm-py"><span class="std std-ref">Layer Normalization</span></a> (<code class="docutils literal notranslate"><span class="pre">05-layer-norm.py</span></code>)</p></td>
<td><p>02:14.484</p></td>
<td><p>02:13.781</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-even"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
<td><p>01:40.152</p></td>
<td><p>01:40.796</p></td>
<td><p>0.0 MB</p></td>
</tr>
<tr class="row-odd"><td><p><a class="reference internal" href="04-low-memory-dropout.html#sphx-glr-getting-started-tutorials-04-low-memory-dropout-py"><span class="std std-ref">Low-Memory Dropout</span></a> (<code class="docutils literal notranslate"><span class="pre">04-low-memory-dropout.py</span></code>)</p></td>
<td><p>00:00.323</p></td>
<td><p>00:00.012</p></td>
<td><p>0.0 MB</p></td>
</tr>
</tbody>

File diff suppressed because one or more lines are too long

View File

@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
config: ff33ced51af7b47c77a5251341a8d663
config: 3066a4dfa51437a71c3821cdef992f3b
tags: 645f666f9bcd5a90fca523b33c5a78b7

Binary file not shown.

Binary file not shown.

Some files were not shown because too many files have changed in this diff Show More