195 lines
4.1 KiB
ReStructuredText
195 lines
4.1 KiB
ReStructuredText
:orphan:
|
|
|
|
|
|
|
|
.. _sphx_glr_getting-started_tutorials:
|
|
|
|
Tutorials
|
|
==================
|
|
|
|
Below is a gallery of tutorials for writing various basic operations with Triton. It is recommended that you read through the tutorials in order, starting with the simplest one.
|
|
|
|
To install the dependencies for the tutorials:
|
|
|
|
.. code-block:: bash
|
|
|
|
cd triton
|
|
pip install -e './python[tutorials]'
|
|
|
|
|
|
|
|
.. raw:: html
|
|
|
|
<div class="sphx-glr-thumbcontainer" tooltip="- The basic programming model of Triton - The triton.jit decorator, which is used to define Tri...">
|
|
|
|
.. only:: html
|
|
|
|
.. figure:: /getting-started/tutorials/images/thumb/sphx_glr_01-vector-add_thumb.png
|
|
:alt: Vector Addition
|
|
|
|
:ref:`sphx_glr_getting-started_tutorials_01-vector-add.py`
|
|
|
|
.. raw:: html
|
|
|
|
</div>
|
|
|
|
|
|
.. toctree::
|
|
:hidden:
|
|
|
|
/getting-started/tutorials/01-vector-add
|
|
|
|
.. raw:: html
|
|
|
|
<div class="sphx-glr-thumbcontainer" tooltip="- The benefits of kernel fusion for bandwidth-bound operations. - Reduction operators in Triton...">
|
|
|
|
.. only:: html
|
|
|
|
.. figure:: /getting-started/tutorials/images/thumb/sphx_glr_02-fused-softmax_thumb.png
|
|
:alt: Fused Softmax
|
|
|
|
:ref:`sphx_glr_getting-started_tutorials_02-fused-softmax.py`
|
|
|
|
.. raw:: html
|
|
|
|
</div>
|
|
|
|
|
|
.. toctree::
|
|
:hidden:
|
|
|
|
/getting-started/tutorials/02-fused-softmax
|
|
|
|
.. raw:: html
|
|
|
|
<div class="sphx-glr-thumbcontainer" tooltip="- Block-level matrix multiplications - Multi-dimensional pointer arithmetic - Program re-orderi...">
|
|
|
|
.. only:: html
|
|
|
|
.. figure:: /getting-started/tutorials/images/thumb/sphx_glr_03-matrix-multiplication_thumb.png
|
|
:alt: Matrix Multiplication
|
|
|
|
:ref:`sphx_glr_getting-started_tutorials_03-matrix-multiplication.py`
|
|
|
|
.. raw:: html
|
|
|
|
</div>
|
|
|
|
|
|
.. toctree::
|
|
:hidden:
|
|
|
|
/getting-started/tutorials/03-matrix-multiplication
|
|
|
|
.. raw:: html
|
|
|
|
<div class="sphx-glr-thumbcontainer" tooltip="In this tutorial, you will write a memory-efficient implementation of dropout whose state will ...">
|
|
|
|
.. only:: html
|
|
|
|
.. figure:: /getting-started/tutorials/images/thumb/sphx_glr_04-low-memory-dropout_thumb.png
|
|
:alt: Low-Memory Dropout
|
|
|
|
:ref:`sphx_glr_getting-started_tutorials_04-low-memory-dropout.py`
|
|
|
|
.. raw:: html
|
|
|
|
</div>
|
|
|
|
|
|
.. toctree::
|
|
:hidden:
|
|
|
|
/getting-started/tutorials/04-low-memory-dropout
|
|
|
|
.. raw:: html
|
|
|
|
<div class="sphx-glr-thumbcontainer" tooltip="Layer Normalization">
|
|
|
|
.. only:: html
|
|
|
|
.. figure:: /getting-started/tutorials/images/thumb/sphx_glr_05-layer-norm_thumb.png
|
|
:alt: Layer Normalization
|
|
|
|
:ref:`sphx_glr_getting-started_tutorials_05-layer-norm.py`
|
|
|
|
.. raw:: html
|
|
|
|
</div>
|
|
|
|
|
|
.. toctree::
|
|
:hidden:
|
|
|
|
/getting-started/tutorials/05-layer-norm
|
|
|
|
.. raw:: html
|
|
|
|
<div class="sphx-glr-thumbcontainer" tooltip="Fused Attention">
|
|
|
|
.. only:: html
|
|
|
|
.. figure:: /getting-started/tutorials/images/thumb/sphx_glr_06-fused-attention_thumb.png
|
|
:alt: Fused Attention
|
|
|
|
:ref:`sphx_glr_getting-started_tutorials_06-fused-attention.py`
|
|
|
|
.. raw:: html
|
|
|
|
</div>
|
|
|
|
|
|
.. toctree::
|
|
:hidden:
|
|
|
|
/getting-started/tutorials/06-fused-attention
|
|
|
|
.. raw:: html
|
|
|
|
<div class="sphx-glr-thumbcontainer" tooltip="In trition/language/libdevice.py, we try to aggregate functions with the same computation but d...">
|
|
|
|
.. only:: html
|
|
|
|
.. figure:: /getting-started/tutorials/images/thumb/sphx_glr_07-libdevice-function_thumb.png
|
|
:alt: Libdevice function
|
|
|
|
:ref:`sphx_glr_getting-started_tutorials_07-libdevice-function.py`
|
|
|
|
.. raw:: html
|
|
|
|
</div>
|
|
|
|
|
|
.. toctree::
|
|
:hidden:
|
|
|
|
/getting-started/tutorials/07-libdevice-function
|
|
.. raw:: html
|
|
|
|
<div class="sphx-glr-clear"></div>
|
|
|
|
|
|
|
|
.. only :: html
|
|
|
|
.. container:: sphx-glr-footer
|
|
:class: sphx-glr-footer-gallery
|
|
|
|
|
|
.. container:: sphx-glr-download sphx-glr-download-python
|
|
|
|
:download:`Download all examples in Python source code: tutorials_python.zip </getting-started/tutorials/tutorials_python.zip>`
|
|
|
|
|
|
|
|
.. container:: sphx-glr-download sphx-glr-download-jupyter
|
|
|
|
:download:`Download all examples in Jupyter notebooks: tutorials_jupyter.zip </getting-started/tutorials/tutorials_jupyter.zip>`
|
|
|
|
|
|
.. only:: html
|
|
|
|
.. rst-class:: sphx-glr-signature
|
|
|
|
`Gallery generated by Sphinx-Gallery <https://sphinx-gallery.github.io>`_
|