[GH-PAGES] Updated website

master/.buildinfo

@@ -1,4 +1,4 @@
 # Sphinx build info version 1
 # This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
-config: 0fc89def95e202aaeae8a473ee883030
+config: 339ccb5e1779e5292300a49b5d2513b2
 tags: 645f666f9bcd5a90fca523b33c5a78b7

master/_sources/getting-started/tutorials/01-vector-add.rst.txt

@@ -237,22 +237,22 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
 
     vector-add-performance:
                size      Triton       Torch
-    0        4096.0    4.363636    9.600000
+    0        4096.0    4.800000    9.600000
-    1        8192.0    9.600000   19.200000
+    1        8192.0   10.666666   19.200000
-    2       16384.0   19.200000   38.400001
+    2       16384.0   17.454545   38.400001
-    3       32768.0   38.400001   76.800002
+    3       32768.0   38.400001   63.999998
-    4       65536.0   76.800002  127.999995
+    4       65536.0   69.818181  127.999995
-    5      131072.0  139.636363  219.428568
+    5      131072.0  127.999995  219.428568
-    6      262144.0  236.307695  341.333321
+    6      262144.0  219.428568  384.000001
     7      524288.0  341.333321  472.615390
     8     1048576.0  472.615390  614.400016
     9     2097152.0  599.414644  702.171410
-    10    4194304.0  702.171410  780.190482
+    10    4194304.0  712.347810  780.190482
-    11    8388608.0  768.000002  812.429770
+    11    8388608.0  774.047204  812.429770
     12   16777216.0  809.086412  833.084721
     13   33554432.0  831.323480  842.004273
     14   67108864.0  841.103727  848.362445
-    15  134217728.0  846.080710  850.656574
+    15  134217728.0  845.625825  850.656574
 
 
 
@@ -260,7 +260,7 @@ We can now run the decorated function above. Pass `print_data=True` to see the p
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 1 minutes  35.628 seconds)
+   **Total running time of the script:** ( 1 minutes  38.714 seconds)
 
 
 .. _sphx_glr_download_getting-started_tutorials_01-vector-add.py:

master/_sources/getting-started/tutorials/02-fused-softmax.rst.txt

@@ -278,17 +278,17 @@ We will then compare its performance against (1) :code:`torch.softmax` and (2) t
 
     softmax-performance:
               N      Triton  Torch (native)  Torch (jit)
-    0     256.0  512.000001      546.133347   190.511628
+    0     256.0  546.133347      546.133347   192.752942
     1     384.0  585.142862      585.142862   151.703707
-    2     512.0  655.360017      585.142849   154.566038
+    2     512.0  655.360017      606.814814   156.038096
-    3     640.0  682.666684      640.000002   158.759699
+    3     640.0  682.666684      640.000002   160.000000
-    4     768.0  722.823517      646.736871   162.754967
+    4     768.0  722.823517      646.736871   163.839992
     ..      ...         ...             ...          ...
-    93  12160.0  814.058574      405.755985   198.429370
+    93  12160.0  814.058574      405.755985   198.834951
-    94  12288.0  814.111783      415.661740   198.794749
+    94  12288.0  815.800825      415.661740   199.096718
-    95  12416.0  814.163950      412.149375   198.358474
+    95  12416.0  814.163950      412.149375   198.705656
-    96  12544.0  814.214963      412.971190   198.520274
+    96  12544.0  814.214963      412.971190   198.913776
-    97  12672.0  814.265046      412.097543   198.679085
+    97  12672.0  814.265046      412.097543   199.069228
 
     [98 rows x 4 columns]
 
@@ -306,7 +306,7 @@ In the above plot, we can see that:
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 3 minutes  26.881 seconds)
+   **Total running time of the script:** ( 3 minutes  26.814 seconds)
 
 
 .. _sphx_glr_download_getting-started_tutorials_02-fused-softmax.py:

master/_sources/getting-started/tutorials/03-matrix-multiplication.rst.txt

@@ -459,36 +459,36 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
     matmul-performance:
              M     cuBLAS  ...     Triton  Triton (+ LeakyReLU)
     0    256.0   2.730667  ...   3.276800              2.978909
-    1    384.0   7.372800  ...   8.507077              8.507077
+    1    384.0   7.372800  ...   7.899428              7.899428
-    2    512.0  14.563555  ...  16.384000             15.420235
+    2    512.0  14.563555  ...  16.384000             16.384000
     3    640.0  22.260869  ...  24.380953             24.380953
     4    768.0  32.768000  ...  35.389441             34.028308
     5    896.0  37.971025  ...  40.140799             40.140799
-    6   1024.0  49.932191  ...  53.773130             52.428801
+    6   1024.0  49.932191  ...  53.773130             53.773130
-    7   1152.0  44.566925  ...  48.161033             47.396572
+    7   1152.0  45.242181  ...  48.161033             47.396572
-    8   1280.0  51.200001  ...  57.690139             57.690139
+    8   1280.0  51.200001  ...  58.514284             57.690139
-    9   1408.0  64.138541  ...  69.009825             69.009825
+    9   1408.0  64.138541  ...  69.009825             68.147202
     10  1536.0  79.526831  ...  80.430545             80.430545
-    11  1664.0  62.929456  ...  62.929456             62.929456
+    11  1664.0  63.372618  ...  63.372618             62.929456
-    12  1792.0  72.512412  ...  63.142831             62.790080
+    12  1792.0  72.983276  ...  63.142831             62.790080
-    13  1920.0  69.120002  ...  71.626943             71.257735
+    13  1920.0  68.776119  ...  71.257735             71.257735
-    14  2048.0  73.262953  ...  78.033565             77.672296
+    14  2048.0  73.584279  ...  78.033565             77.672296
     15  2176.0  83.155572  ...  87.115360             86.739860
-    16  2304.0  68.446623  ...  77.810656             77.057651
+    16  2304.0  68.446623  ...  77.810656             77.558029
-    17  2432.0  71.125224  ...  75.320281             75.118889
+    17  2432.0  71.125224  ...  75.522751             75.118889
-    18  2560.0  77.833728  ...  81.920002             82.125311
+    18  2560.0  77.833728  ...  82.125311             81.715711
-    19  2688.0  83.552988  ...  90.102270             90.316801
+    19  2688.0  83.552988  ...  90.316801             89.888756
-    20  2816.0  79.879498  ...  84.197315             83.552120
+    20  2816.0  80.173175  ...  83.873477             83.392363
-    21  2944.0  78.854483  ...  82.509987             83.617504
+    21  2944.0  81.034195  ...  84.040530             82.237674
-    22  3072.0  82.420822  ...  89.593522             89.877939
+    22  3072.0  82.301023  ...  89.310890             89.030036
-    23  3200.0  84.432717  ...  96.385543             95.096582
+    23  3200.0  82.156612  ...  96.385543             96.822991
-    24  3328.0  82.275764  ...  84.003845             84.695641
+    24  3328.0  83.516586  ...  85.500351             85.703924
-    25  3456.0  82.099354  ...  91.407671             91.824110
+    25  3456.0  81.683457  ...  86.226274             86.783176
-    26  3584.0  82.377818  ...  91.380335             93.370085
+    26  3584.0  87.211821  ...  98.808123             99.408944
-    27  3712.0  84.730571  ...  89.594031             83.876864
+    27  3712.0  84.159518  ...  86.641231             88.248537
-    28  3840.0  84.615146  ...  92.545605             85.663823
+    28  3840.0  79.391241  ...  85.136259             91.247522
-    29  3968.0  90.859224  ...  85.932350             86.726322
+    29  3968.0  87.097744  ...  91.472214             84.797731
-    30  4096.0  93.825748  ...  86.037005             88.475759
+    30  4096.0  93.401342  ...  84.096318             86.092193
 
     [31 rows x 5 columns]
 
@@ -498,7 +498,7 @@ We can now compare the performance of our kernel against that of cuBLAS. Here we
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 6 minutes  4.629 seconds)
+   **Total running time of the script:** ( 6 minutes  4.871 seconds)
 
 
 .. _sphx_glr_download_getting-started_tutorials_03-matrix-multiplication.py:

master/_sources/getting-started/tutorials/04-low-memory-dropout.rst.txt

@@ -240,7 +240,7 @@ References
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 0 minutes  0.012 seconds)
+   **Total running time of the script:** ( 0 minutes  0.016 seconds)
 
 
 .. _sphx_glr_download_getting-started_tutorials_04-low-memory-dropout.py:

master/_sources/getting-started/tutorials/05-layer-norm.rst.txt

@@ -38,36 +38,36 @@ Layer Normalization
 
     layer-norm-backward:
               N      Triton       Torch        Apex
-    0    1024.0  356.173905   99.497980  315.076934
+    0    1024.0  361.411758   99.902435  315.076934
-    1    1536.0  405.098894  134.050910  341.333333
+    1    1536.0  405.098894  134.540150  344.523365
-    2    2048.0  491.520012  159.067963  321.254900
+    2    2048.0  491.520012  159.584422  323.368435
-    3    2560.0  458.507457  182.314537  326.808501
+    3    2560.0  458.507457  182.857144  325.079368
-    4    3072.0  519.211251  191.501303  319.168834
+    4    3072.0  519.211251  191.999993  320.556515
-    5    3584.0  554.941930  207.768111  308.301075
+    5    3584.0  554.941930  208.271186  310.527060
-    6    4096.0  561.737163  220.907859  296.096389
+    6    4096.0  568.231237  221.405403  301.546004
-    7    4608.0  500.416301  232.336141  291.031570
+    7    4608.0  502.690905  232.336141  287.251954
-    8    5120.0  527.381977  243.809526  289.811322
+    8    5120.0  527.381977  243.809526  286.433562
-    9    5632.0  540.671974  244.426754  291.310338
+    9    5632.0  542.843364  244.647957  291.939522
     10   6144.0  550.208948  251.202731  287.438593
-    11   6656.0  532.479975  255.590406  286.279570
+    11   6656.0  532.479975  255.590406  286.793541
-    12   7168.0  510.480705  253.360829  277.470965
+    12   7168.0  510.480705  253.734520  277.470965
-    13   7680.0  486.332448  266.743841  284.884090
+    13   7680.0  487.619051  266.358392  284.884090
-    14   8192.0  468.114289  258.354805  278.087683
+    14   8192.0  468.114289  258.354805  278.481578
-    15   8704.0  414.476194  267.472468  284.987724
+    15   8704.0  415.300208  267.815384  285.377055
-    16   9216.0  430.319054  272.394084  289.887291
+    16   9216.0  431.157889  272.394084  289.887291
-    17   9728.0  438.033784  279.942444  288.950501
+    17   9728.0  438.033784  280.278512  289.308559
-    18  10240.0  443.610086  287.102804  290.153487
+    18  10240.0  442.810829  287.438599  290.496460
-    19  10752.0  427.231788  246.699797  289.941565
+    19  10752.0  426.525614  246.935876  289.941565
-    20  11264.0  427.071098  245.760001  286.069848
+    20  11264.0  427.071098  245.536784  286.069848
-    21  11776.0  419.323436  249.667843  288.686414
+    21  11776.0  419.323436  249.447482  288.686414
-    22  12288.0  415.369018  254.673582  294.617366
+    22  12288.0  415.954875  254.893699  294.617366
-    23  12800.0  410.695192  254.094291  288.180121
+    23  12800.0  411.244989  254.094291  289.538159
-    24  13312.0  410.125805  252.360194  289.129403
+    24  13312.0  410.652963  252.559690  289.391298
-    25  13824.0  404.112047  257.190689  291.799461
+    25  13824.0  404.604870  257.190689  292.056329
-    26  14336.0  396.844280  256.000002  288.886653
+    26  14336.0  396.387109  256.190622  289.129416
-    27  14848.0  386.080180  257.665934  288.544136
+    27  14848.0  386.080180  257.665934  288.777966
-    28  15360.0  378.869469  258.332158  285.989131
+    28  15360.0  379.649845  258.513318  286.656296
-    29  15872.0  372.000001  261.626369  290.120338
+    29  15872.0  372.000001  261.806182  290.341468
 
 
 
@@ -339,7 +339,7 @@ Layer Normalization
 
 .. rst-class:: sphx-glr-timing
 
-   **Total running time of the script:** ( 2 minutes  13.230 seconds)
+   **Total running time of the script:** ( 2 minutes  12.229 seconds)
 
 
 .. _sphx_glr_download_getting-started_tutorials_05-layer-norm.py:

master/_sources/getting-started/tutorials/sg_execution_times.rst.txt

@@ -5,16 +5,16 @@
 
 Computation times
 =================
-**13:20.380** total execution time for **getting-started_tutorials** files:
+**13:22.644** total execution time for **getting-started_tutorials** files:
 
 +---------------------------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 06:04.629 | 0.0 MB |
+| :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py` (``03-matrix-multiplication.py``) | 06:04.871 | 0.0 MB |
 +---------------------------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``)                 | 03:26.881 | 0.0 MB |
+| :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py` (``02-fused-softmax.py``)                 | 03:26.814 | 0.0 MB |
 +---------------------------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_getting-started_tutorials_05-layer-norm.py` (``05-layer-norm.py``)                       | 02:13.230 | 0.0 MB |
+| :ref:`sphx_glr_getting-started_tutorials_05-layer-norm.py` (``05-layer-norm.py``)                       | 02:12.229 | 0.0 MB |
 +---------------------------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``)                       | 01:35.628 | 0.0 MB |
+| :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py` (``01-vector-add.py``)                       | 01:38.714 | 0.0 MB |
 +---------------------------------------------------------------------------------------------------------+-----------+--------+
-| :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py` (``04-low-memory-dropout.py``)       | 00:00.012 | 0.0 MB |
+| :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py` (``04-low-memory-dropout.py``)       | 00:00.016 | 0.0 MB |
 +---------------------------------------------------------------------------------------------------------+-----------+--------+

master/getting-started/tutorials/01-vector-add.html

@@ -327,25 +327,25 @@ for different problem sizes.</p>
 <p class="sphx-glr-script-out">Out:</p>
 <div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>vector-add-performance:
            size      Triton       Torch
-0        4096.0    4.363636    9.600000
+0        4096.0    4.800000    9.600000
-1        8192.0    9.600000   19.200000
+1        8192.0   10.666666   19.200000
-2       16384.0   19.200000   38.400001
+2       16384.0   17.454545   38.400001
-3       32768.0   38.400001   76.800002
+3       32768.0   38.400001   63.999998
-4       65536.0   76.800002  127.999995
+4       65536.0   69.818181  127.999995
-5      131072.0  139.636363  219.428568
+5      131072.0  127.999995  219.428568
-6      262144.0  236.307695  341.333321
+6      262144.0  219.428568  384.000001
 7      524288.0  341.333321  472.615390
 8     1048576.0  472.615390  614.400016
 9     2097152.0  599.414644  702.171410
-10    4194304.0  702.171410  780.190482
+10    4194304.0  712.347810  780.190482
-11    8388608.0  768.000002  812.429770
+11    8388608.0  774.047204  812.429770
 12   16777216.0  809.086412  833.084721
 13   33554432.0  831.323480  842.004273
 14   67108864.0  841.103727  848.362445
-15  134217728.0  846.080710  850.656574
+15  134217728.0  845.625825  850.656574
 </pre></div>
 </div>
-<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes  35.628 seconds)</p>
+<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 1 minutes  38.714 seconds)</p>
 <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-01-vector-add-py">
 <div class="sphx-glr-download sphx-glr-download-python docutils container">
 <p><a class="reference download internal" download="" href="../../_downloads/62d97d49a32414049819dd8bb8378080/01-vector-add.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">01-vector-add.py</span></code></a></p>

master/getting-started/tutorials/02-fused-softmax.html

@@ -369,17 +369,17 @@ We will then compare its performance against (1) <code class="code docutils lite
 <p class="sphx-glr-script-out">Out:</p>
 <div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>softmax-performance:
           N      Triton  Torch (native)  Torch (jit)
-0     256.0  512.000001      546.133347   190.511628
+0     256.0  546.133347      546.133347   192.752942
 1     384.0  585.142862      585.142862   151.703707
-2     512.0  655.360017      585.142849   154.566038
+2     512.0  655.360017      606.814814   156.038096
-3     640.0  682.666684      640.000002   158.759699
+3     640.0  682.666684      640.000002   160.000000
-4     768.0  722.823517      646.736871   162.754967
+4     768.0  722.823517      646.736871   163.839992
 ..      ...         ...             ...          ...
-93  12160.0  814.058574      405.755985   198.429370
+93  12160.0  814.058574      405.755985   198.834951
-94  12288.0  814.111783      415.661740   198.794749
+94  12288.0  815.800825      415.661740   199.096718
-95  12416.0  814.163950      412.149375   198.358474
+95  12416.0  814.163950      412.149375   198.705656
-96  12544.0  814.214963      412.971190   198.520274
+96  12544.0  814.214963      412.971190   198.913776
-97  12672.0  814.265046      412.097543   198.679085
+97  12672.0  814.265046      412.097543   199.069228
 
 [98 rows x 4 columns]
 </pre></div>
@@ -392,7 +392,7 @@ We will then compare its performance against (1) <code class="code docutils lite
 Note however that the PyTorch <cite>softmax</cite> operation is more general and will works on tensors of any shape.</p></li>
 </ul>
 </div></blockquote>
-<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 3 minutes  26.881 seconds)</p>
+<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 3 minutes  26.814 seconds)</p>
 <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-02-fused-softmax-py">
 <div class="sphx-glr-download sphx-glr-download-python docutils container">
 <p><a class="reference download internal" download="" href="../../_downloads/d91442ac2982c4e0cc3ab0f43534afbc/02-fused-softmax.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">02-fused-softmax.py</span></code></a></p>

master/getting-started/tutorials/03-matrix-multiplication.html

@@ -565,41 +565,41 @@ torch_output=tensor([[  1.1045, -36.9688,  31.4688,  ..., -11.3906,  24.4531, -3
 <div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>matmul-performance:
          M     cuBLAS  ...     Triton  Triton (+ LeakyReLU)
 0    256.0   2.730667  ...   3.276800              2.978909
-1    384.0   7.372800  ...   8.507077              8.507077
+1    384.0   7.372800  ...   7.899428              7.899428
-2    512.0  14.563555  ...  16.384000             15.420235
+2    512.0  14.563555  ...  16.384000             16.384000
 3    640.0  22.260869  ...  24.380953             24.380953
 4    768.0  32.768000  ...  35.389441             34.028308
 5    896.0  37.971025  ...  40.140799             40.140799
-6   1024.0  49.932191  ...  53.773130             52.428801
+6   1024.0  49.932191  ...  53.773130             53.773130
-7   1152.0  44.566925  ...  48.161033             47.396572
+7   1152.0  45.242181  ...  48.161033             47.396572
-8   1280.0  51.200001  ...  57.690139             57.690139
+8   1280.0  51.200001  ...  58.514284             57.690139
-9   1408.0  64.138541  ...  69.009825             69.009825
+9   1408.0  64.138541  ...  69.009825             68.147202
 10  1536.0  79.526831  ...  80.430545             80.430545
-11  1664.0  62.929456  ...  62.929456             62.929456
+11  1664.0  63.372618  ...  63.372618             62.929456
-12  1792.0  72.512412  ...  63.142831             62.790080
+12  1792.0  72.983276  ...  63.142831             62.790080
-13  1920.0  69.120002  ...  71.626943             71.257735
+13  1920.0  68.776119  ...  71.257735             71.257735
-14  2048.0  73.262953  ...  78.033565             77.672296
+14  2048.0  73.584279  ...  78.033565             77.672296
 15  2176.0  83.155572  ...  87.115360             86.739860
-16  2304.0  68.446623  ...  77.810656             77.057651
+16  2304.0  68.446623  ...  77.810656             77.558029
-17  2432.0  71.125224  ...  75.320281             75.118889
+17  2432.0  71.125224  ...  75.522751             75.118889
-18  2560.0  77.833728  ...  81.920002             82.125311
+18  2560.0  77.833728  ...  82.125311             81.715711
-19  2688.0  83.552988  ...  90.102270             90.316801
+19  2688.0  83.552988  ...  90.316801             89.888756
-20  2816.0  79.879498  ...  84.197315             83.552120
+20  2816.0  80.173175  ...  83.873477             83.392363
-21  2944.0  78.854483  ...  82.509987             83.617504
+21  2944.0  81.034195  ...  84.040530             82.237674
-22  3072.0  82.420822  ...  89.593522             89.877939
+22  3072.0  82.301023  ...  89.310890             89.030036
-23  3200.0  84.432717  ...  96.385543             95.096582
+23  3200.0  82.156612  ...  96.385543             96.822991
-24  3328.0  82.275764  ...  84.003845             84.695641
+24  3328.0  83.516586  ...  85.500351             85.703924
-25  3456.0  82.099354  ...  91.407671             91.824110
+25  3456.0  81.683457  ...  86.226274             86.783176
-26  3584.0  82.377818  ...  91.380335             93.370085
+26  3584.0  87.211821  ...  98.808123             99.408944
-27  3712.0  84.730571  ...  89.594031             83.876864
+27  3712.0  84.159518  ...  86.641231             88.248537
-28  3840.0  84.615146  ...  92.545605             85.663823
+28  3840.0  79.391241  ...  85.136259             91.247522
-29  3968.0  90.859224  ...  85.932350             86.726322
+29  3968.0  87.097744  ...  91.472214             84.797731
-30  4096.0  93.825748  ...  86.037005             88.475759
+30  4096.0  93.401342  ...  84.096318             86.092193
 
 [31 rows x 5 columns]
 </pre></div>
 </div>
-<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 6 minutes  4.629 seconds)</p>
+<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 6 minutes  4.871 seconds)</p>
 <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-03-matrix-multiplication-py">
 <div class="sphx-glr-download sphx-glr-download-python docutils container">
 <p><a class="reference download internal" download="" href="../../_downloads/d5fee5b55a64e47f1b5724ec39adf171/03-matrix-multiplication.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">03-matrix-multiplication.py</span></code></a></p>

master/getting-started/tutorials/04-low-memory-dropout.html

@@ -372,7 +372,7 @@ to explore the <cite>triton/language/random</cite> folder!</p>
 <dd><p>Nitish Srivastava and Geoffrey Hinton and Alex Krizhevsky and Ilya Sutskever and Ruslan Salakhutdinov, “Dropout: A Simple Way to Prevent Neural Networks from Overfitting”, JMLR 2014</p>
 </dd>
 </dl>
-<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes  0.012 seconds)</p>
+<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 0 minutes  0.016 seconds)</p>
 <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-04-low-memory-dropout-py">
 <div class="sphx-glr-download sphx-glr-download-python docutils container">
 <p><a class="reference download internal" download="" href="../../_downloads/c9aed78977a4c05741d675a38dde3d7d/04-low-memory-dropout.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">04-low-memory-dropout.py</span></code></a></p>

master/getting-started/tutorials/05-layer-norm.html

@@ -194,36 +194,36 @@ to download the full example code</p>
 <p class="sphx-glr-script-out">Out:</p>
 <div class="sphx-glr-script-out highlight-none notranslate"><div class="highlight"><pre><span></span>layer-norm-backward:
           N      Triton       Torch        Apex
-0    1024.0  356.173905   99.497980  315.076934
+0    1024.0  361.411758   99.902435  315.076934
-1    1536.0  405.098894  134.050910  341.333333
+1    1536.0  405.098894  134.540150  344.523365
-2    2048.0  491.520012  159.067963  321.254900
+2    2048.0  491.520012  159.584422  323.368435
-3    2560.0  458.507457  182.314537  326.808501
+3    2560.0  458.507457  182.857144  325.079368
-4    3072.0  519.211251  191.501303  319.168834
+4    3072.0  519.211251  191.999993  320.556515
-5    3584.0  554.941930  207.768111  308.301075
+5    3584.0  554.941930  208.271186  310.527060
-6    4096.0  561.737163  220.907859  296.096389
+6    4096.0  568.231237  221.405403  301.546004
-7    4608.0  500.416301  232.336141  291.031570
+7    4608.0  502.690905  232.336141  287.251954
-8    5120.0  527.381977  243.809526  289.811322
+8    5120.0  527.381977  243.809526  286.433562
-9    5632.0  540.671974  244.426754  291.310338
+9    5632.0  542.843364  244.647957  291.939522
 10   6144.0  550.208948  251.202731  287.438593
-11   6656.0  532.479975  255.590406  286.279570
+11   6656.0  532.479975  255.590406  286.793541
-12   7168.0  510.480705  253.360829  277.470965
+12   7168.0  510.480705  253.734520  277.470965
-13   7680.0  486.332448  266.743841  284.884090
+13   7680.0  487.619051  266.358392  284.884090
-14   8192.0  468.114289  258.354805  278.087683
+14   8192.0  468.114289  258.354805  278.481578
-15   8704.0  414.476194  267.472468  284.987724
+15   8704.0  415.300208  267.815384  285.377055
-16   9216.0  430.319054  272.394084  289.887291
+16   9216.0  431.157889  272.394084  289.887291
-17   9728.0  438.033784  279.942444  288.950501
+17   9728.0  438.033784  280.278512  289.308559
-18  10240.0  443.610086  287.102804  290.153487
+18  10240.0  442.810829  287.438599  290.496460
-19  10752.0  427.231788  246.699797  289.941565
+19  10752.0  426.525614  246.935876  289.941565
-20  11264.0  427.071098  245.760001  286.069848
+20  11264.0  427.071098  245.536784  286.069848
-21  11776.0  419.323436  249.667843  288.686414
+21  11776.0  419.323436  249.447482  288.686414
-22  12288.0  415.369018  254.673582  294.617366
+22  12288.0  415.954875  254.893699  294.617366
-23  12800.0  410.695192  254.094291  288.180121
+23  12800.0  411.244989  254.094291  289.538159
-24  13312.0  410.125805  252.360194  289.129403
+24  13312.0  410.652963  252.559690  289.391298
-25  13824.0  404.112047  257.190689  291.799461
+25  13824.0  404.604870  257.190689  292.056329
-26  14336.0  396.844280  256.000002  288.886653
+26  14336.0  396.387109  256.190622  289.129416
-27  14848.0  386.080180  257.665934  288.544136
+27  14848.0  386.080180  257.665934  288.777966
-28  15360.0  378.869469  258.332158  285.989131
+28  15360.0  379.649845  258.513318  286.656296
-29  15872.0  372.000001  261.626369  290.120338
+29  15872.0  372.000001  261.806182  290.341468
 </pre></div>
 </div>
 <div class="line-block">
@@ -487,7 +487,7 @@ to download the full example code</p>
 <span class="n">bench_layer_norm</span><span class="o">.</span><span class="n">run</span><span class="p">(</span><span class="n">save_path</span><span class="o">=</span><span class="s1">&#39;.&#39;</span><span class="p">,</span> <span class="n">print_data</span><span class="o">=</span><span class="kc">True</span><span class="p">)</span>
 </pre></div>
 </div>
-<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes  13.230 seconds)</p>
+<p class="sphx-glr-timing"><strong>Total running time of the script:</strong> ( 2 minutes  12.229 seconds)</p>
 <div class="sphx-glr-footer class sphx-glr-footer-example docutils container" id="sphx-glr-download-getting-started-tutorials-05-layer-norm-py">
 <div class="sphx-glr-download sphx-glr-download-python docutils container">
 <p><a class="reference download internal" download="" href="../../_downloads/935c0dd0fbeb4b2e69588471cbb2d4b2/05-layer-norm.py"><code class="xref download docutils literal notranslate"><span class="pre">Download</span> <span class="pre">Python</span> <span class="pre">source</span> <span class="pre">code:</span> <span class="pre">05-layer-norm.py</span></code></a></p>

master/getting-started/tutorials/sg_execution_times.html

@@ -174,7 +174,7 @@
             
   <div class="section" id="computation-times">
 <span id="sphx-glr-getting-started-tutorials-sg-execution-times"></span><h1>Computation times<a class="headerlink" href="#computation-times" title="Permalink to this headline">¶</a></h1>
-<p><strong>13:20.380</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
+<p><strong>13:22.644</strong> total execution time for <strong>getting-started_tutorials</strong> files:</p>
 <table class="docutils align-default">
 <colgroup>
 <col style="width: 85%" />
@@ -183,23 +183,23 @@
 </colgroup>
 <tbody>
 <tr class="row-odd"><td><p><a class="reference internal" href="03-matrix-multiplication.html#sphx-glr-getting-started-tutorials-03-matrix-multiplication-py"><span class="std std-ref">Matrix Multiplication</span></a> (<code class="docutils literal notranslate"><span class="pre">03-matrix-multiplication.py</span></code>)</p></td>
-<td><p>06:04.629</p></td>
+<td><p>06:04.871</p></td>
 <td><p>0.0 MB</p></td>
 </tr>
 <tr class="row-even"><td><p><a class="reference internal" href="02-fused-softmax.html#sphx-glr-getting-started-tutorials-02-fused-softmax-py"><span class="std std-ref">Fused Softmax</span></a> (<code class="docutils literal notranslate"><span class="pre">02-fused-softmax.py</span></code>)</p></td>
-<td><p>03:26.881</p></td>
+<td><p>03:26.814</p></td>
 <td><p>0.0 MB</p></td>
 </tr>
 <tr class="row-odd"><td><p><a class="reference internal" href="05-layer-norm.html#sphx-glr-getting-started-tutorials-05-layer-norm-py"><span class="std std-ref">Layer Normalization</span></a> (<code class="docutils literal notranslate"><span class="pre">05-layer-norm.py</span></code>)</p></td>
-<td><p>02:13.230</p></td>
+<td><p>02:12.229</p></td>
 <td><p>0.0 MB</p></td>
 </tr>
 <tr class="row-even"><td><p><a class="reference internal" href="01-vector-add.html#sphx-glr-getting-started-tutorials-01-vector-add-py"><span class="std std-ref">Vector Addition</span></a> (<code class="docutils literal notranslate"><span class="pre">01-vector-add.py</span></code>)</p></td>
-<td><p>01:35.628</p></td>
+<td><p>01:38.714</p></td>
 <td><p>0.0 MB</p></td>
 </tr>
 <tr class="row-odd"><td><p><a class="reference internal" href="04-low-memory-dropout.html#sphx-glr-getting-started-tutorials-04-low-memory-dropout-py"><span class="std std-ref">Low-Memory Dropout</span></a> (<code class="docutils literal notranslate"><span class="pre">04-low-memory-dropout.py</span></code>)</p></td>
-<td><p>00:00.012</p></td>
+<td><p>00:00.016</p></td>
 <td><p>0.0 MB</p></td>
 </tr>
 </tbody>

v1.1.2/.buildinfo

@@ -1,4 +1,4 @@
 # Sphinx build info version 1
 # This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
-config: c335ebe116c5e76aa9062e08c7bd94e6
+config: f9b6a6ab1020751f5e1d85b1dde6a9b8
 tags: 645f666f9bcd5a90fca523b33c5a78b7