triton/master/_sources/getting-started/tutorials/index.rst.txt

:orphan:



.. _sphx_glr_getting-started_tutorials:

Tutorials
==================

Below is a gallery of tutorials for writing various basic operations with Triton. It is recommended that you read through the tutorials in order, starting with the simplest one.

To install the dependencies for the tutorials:

.. code-block:: bash

    cd triton
    pip install -e './python[tutorials]'



.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="- The basic programming model of Triton - The triton.jit decorator, which is used to define Tri...">

.. only:: html

 .. figure:: /getting-started/tutorials/images/thumb/sphx_glr_01-vector-add_thumb.png
     :alt: Vector Addition

     :ref:`sphx_glr_getting-started_tutorials_01-vector-add.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /getting-started/tutorials/01-vector-add

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="- The benefits of kernel fusion for bandwidth-bound operations. - Reduction operators in Triton...">

.. only:: html

 .. figure:: /getting-started/tutorials/images/thumb/sphx_glr_02-fused-softmax_thumb.png
     :alt: Fused Softmax

     :ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /getting-started/tutorials/02-fused-softmax

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="- Block-level matrix multiplications - Multi-dimensional pointer arithmetic - Program re-orderi...">

.. only:: html

 .. figure:: /getting-started/tutorials/images/thumb/sphx_glr_03-matrix-multiplication_thumb.png
     :alt: Matrix Multiplication

     :ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /getting-started/tutorials/03-matrix-multiplication

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="In this tutorial, you will write a memory-efficient implementation of dropout whose state will ...">

.. only:: html

 .. figure:: /getting-started/tutorials/images/thumb/sphx_glr_04-low-memory-dropout_thumb.png
     :alt: Low-Memory Dropout

     :ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /getting-started/tutorials/04-low-memory-dropout

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Layer Normalization">

.. only:: html

 .. figure:: /getting-started/tutorials/images/thumb/sphx_glr_05-layer-norm_thumb.png
     :alt: Layer Normalization

     :ref:`sphx_glr_getting-started_tutorials_05-layer-norm.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /getting-started/tutorials/05-layer-norm

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Fused Attention">

.. only:: html

 .. figure:: /getting-started/tutorials/images/thumb/sphx_glr_06-fused-attention_thumb.png
     :alt: Fused Attention

     :ref:`sphx_glr_getting-started_tutorials_06-fused-attention.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /getting-started/tutorials/06-fused-attention

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="In trition/language/libdevice.py, we try to aggregate functions with the same computation but d...">

.. only:: html

 .. figure:: /getting-started/tutorials/images/thumb/sphx_glr_07-libdevice-function_thumb.png
     :alt: Libdevice function

     :ref:`sphx_glr_getting-started_tutorials_07-libdevice-function.py`

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /getting-started/tutorials/07-libdevice-function
.. raw:: html

    <div class="sphx-glr-clear"></div>



.. only :: html

 .. container:: sphx-glr-footer
    :class: sphx-glr-footer-gallery


  .. container:: sphx-glr-download sphx-glr-download-python

    :download:`Download all examples in Python source code: tutorials_python.zip </getting-started/tutorials/tutorials_python.zip>`



  .. container:: sphx-glr-download sphx-glr-download-jupyter

    :download:`Download all examples in Jupyter notebooks: tutorials_jupyter.zip </getting-started/tutorials/tutorials_jupyter.zip>`


.. only:: html

 .. rst-class:: sphx-glr-signature

    `Gallery generated by Sphinx-Gallery <https://sphinx-gallery.github.io>`_