Philippe Tillet
cd21151b98
[GENERAL] Fixed some undefined behavior with GCC-9
2020-05-11 11:07:21 -04:00
Philippe Tillet
7c09ff80eb
[CORE] Fixed several issues that arose in the development of the
...
torch-blocksparse package:
* Now using warp shuffle in reductions when possible
* Various bugfixes in layout inference
* Added INFINITY, exponential and select
* Better error messages for unimplemented constructs
2020-03-31 18:57:28 -04:00
Philippe Tillet
a27b96cad1
[CORE][DRIVER] Now only using PTX6.4 if CUDA10.1+ is detected
2020-03-05 21:29:22 -05:00
Philippe Tillet
f2daff85d2
[GENERAL] Improved caching mechanism:
...
* Now computing hash in libtriton
* Now only compiling a single pytorch hook per function signature
2020-02-24 16:36:50 -05:00
Philippe Tillet
f278d9741a
[GENERAL] Merged einsum feature branch. Various feature, performance
...
improvements and bugfixes:
* Added preliminary support for extended Einstein summation in PyTriton
* Significant performance improvement on FP32 kernels containing matrix
multiplication
* Added re-coalescing pass for FP16 kernels containing matrix
multiplication
* Various bugfixes
2020-01-20 12:42:48 -05:00
Philippe Tillet
f4bbbbe5e4
[PYTHON][OPS] Bugfix in conv fprop
2019-11-01 00:43:02 -04:00
Philippe Tillet
96cba9036a
[tests] [unit] added 1D and 3D reduction test
2019-10-20 17:48:19 -04:00
Philippe Tillet
b43454c9b7
[codegen] [membar] view do not write to shared memory
2019-10-17 22:38:41 -04:00
Philippe Tillet
e787ce0cab
[codegen] more cleaning
2019-10-13 02:26:30 -04:00
Philippe Tillet
ee3803b577
more cleaning
2019-10-11 19:29:24 -04:00
Philippe Tillet
323c90e431
ugh
2019-10-11 19:05:54 -04:00
Philippe Tillet
a1e0512703
[codegen] more progress
2019-10-03 14:11:50 -04:00
Philippe Tillet
86a3e5d897
[codegen] now matrix-multiplication is bank-conflict free for all
...
layouts
2019-10-01 16:57:59 -04:00
Philippe Tillet
ed1b2bc563
more work on padding
2019-09-27 22:15:30 -04:00
Philippe Tillet
a3bf3a1804
[codegen] more hmma row-major handling
2019-09-24 19:35:46 -04:00
Philippe Tillet
c24d55db23
[codegen] more work on hmma coalescing
2019-09-23 20:38:27 -04:00
Philippe Tillet
f0013f8bf1
[codegen] [allocation] fixed issues in HMMA
2019-09-23 17:54:42 -04:00
Philippe Tillet
b95ac15d48
[codegen] [selection] fixed synchronization issue with double-buffering
2019-09-23 13:56:46 -04:00
Philippe Tillet
001973630e
[codegen] cleaned up shared memory and double-buffering logic
2019-09-21 22:21:40 -04:00
Philippe Tillet
e35be1ddcf
[ir][instruction] added identifier for each instruction
2019-09-19 16:25:36 -04:00
Philippe Tillet
1fd9be27ee
[tests][bench] now benchmarking all variants of copy
2019-09-17 22:17:58 -04:00
Philippe Tillet
e01e623333
[codegen][auto-coalesce] more debugging
2019-09-16 20:34:08 -04:00
Philippe Tillet
579a662e60
[codegen][coalesce] more bugfixes
2019-09-13 14:17:21 -04:00
Philippe Tillet
11ff27d638
[codegen][coalesce] some bugfix for phi-nodes
2019-09-12 22:44:07 -04:00
Philippe Tillet
32234c2612
ugh
2019-09-08 17:35:24 -04:00
Philippe Tillet
18848cbb71
[driver] now passing std::unique_ptr<> instead of cloning LLVM module
...
when compiling it
2019-09-05 17:25:58 -04:00
Philippe Tillet
b747959a57
trying to work around tensorflow limitations
2019-09-04 01:54:43 -04:00
Philippe Tillet
2ccc915011
[python][examples] added template for blocksparse
2019-09-03 20:44:27 -04:00
Philippe Tillet
97fdb5b6be
[tests] added missing files
2019-09-03 12:44:35 -04:00
Philippe Tillet
a842d337c5
[general] various cleaning and bugfix:
...
* added copy1d and copy2d benchmark
* fixed issue in reassociation pass
2019-09-02 23:00:49 -04:00
Philippe Tillet
7e0af2118c
[codegen] worked around bug seemingly from nvptx/ptxas by simplifying multiplications by 1:
...
- Generated LLVM-IR looked correct
- Illegal addressing disappeared when running cuda-memcheck
- Illegal addressing disappeared when using nvptx-short-pointer
2019-08-30 16:45:14 -07:00
Philippe Tillet
d457482539
[codegen] fixed issue in double buffering pointer update
2019-08-28 17:50:45 -07:00
Philippe Tillet
37cbcfabd0
[examples] back to 96 TFLOPS on V100
2019-08-26 22:49:14 -07:00
Philippe Tillet
b4ae06a714
tracking down performance regression
2019-08-26 20:38:39 -07:00
Philippe Tillet
cb04ec0b3b
some more cleaning
2019-08-23 19:22:38 -07:00
Philippe Tillet
732156b942
[general] rename *.cpp -> *.cc
2019-08-23 19:06:39 -07:00