Philippe Tillet
ce7a00674a
[PYTHON][EXAMPLES] Added self-attention example using triton.ops.einsum
2020-01-21 16:45:04 -05:00
Philippe Tillet
78b98fb7cf
[GENERAL] Cleaned polymorphic structure of layouts analysis pass
2020-01-21 11:38:39 -05:00
Philippe Tillet
382ca2c745
[CODEGEN][ANALYSIS] cleaning: moving towards better polymorphism for
...
tile layouts
2020-01-20 12:43:04 -05:00
Philippe Tillet
fbf2a3f56f
[CODEGEN][TRANSFORM] some bug-fixes for FP32 einsum
2020-01-20 12:42:53 -05:00
Philippe Tillet
f278d9741a
[GENERAL] Merged einsum feature branch. Various feature, performance
...
improvements and bugfixes:
* Added preliminary support for extended Einstein summation in PyTriton
* Significant performance improvement on FP32 kernels containing matrix
multiplication
* Added re-coalescing pass for FP16 kernels containing matrix
multiplication
* Various bugfixes
2020-01-20 12:42:48 -05:00
Philippe Tillet
50a52df489
[PYTHON][OPS] Convolution: Some cleaning of Triton-C kernel
2019-11-01 11:21:30 -04:00
Philippe Tillet
f4bbbbe5e4
[PYTHON][OPS] Bugfix in conv fprop
2019-11-01 00:43:02 -04:00
Philippe Tillet
739a8d9061
some work on conv
2019-10-31 18:08:27 -04:00
Philippe Tillet
91a2fd463b
[PYTHON][TENSORFLOW] More bugfixes for forward/backward signatures
2019-10-31 01:49:30 -04:00
Philippe Tillet
93a86d4fc6
[PYTHON][TENSORFLOW] Signature of function.forward() does not have to
...
match signature of kernel anymore
2019-10-30 20:29:23 -04:00
Philippe Tillet
e0fe8d9058
[PYTHON][TENSORFLOW] More work
2019-10-30 18:39:58 -04:00
Philippe Tillet
fd09f9c99d
fixup
2019-10-30 13:48:55 -04:00
Philippe Tillet
9b0f1a0807
more stuff
2019-10-30 13:44:31 -04:00
Philippe Tillet
bf3dc63858
[PYTHON] Removed dead code for alloc_empty and register_scalar
2019-10-30 10:37:30 -04:00
Philippe Tillet
f4fcaf84df
[PYTHON][EXAMPLES] Added example for batchnorm
2019-10-30 01:49:42 -04:00
Philippe Tillet
2b9355c9e4
[PYTHON][TENSORFLOW] Got rid of alloc_empty entirely; now doing
...
generating allocation code inside the tensorflow op
2019-10-30 01:38:30 -04:00
Philippe Tillet
d65a94c768
[PYTHON][OPS] Added batch normalization op
2019-10-29 17:29:11 -04:00
Philippe Tillet
d9eacf937c
[PYTHON][FUNCTION] Now using common grad output format for both
...
tensorflow and pytorch
2019-10-29 14:09:40 -04:00
Philippe Tillet
76651a065f
[PYTHON][EXAMPLES] Better einsum example
2019-10-29 12:56:58 -04:00
Philippe Tillet
448f4433d9
[PYTHON][KERNEL] Enforcing shapes to be known at compile-time for
...
TensorFlow Graph Execution
2019-10-29 00:48:53 -04:00
Philippe Tillet
e9c787ef05
[PYTHON][EINSUM] Added support for FP16
2019-10-28 14:07:17 -04:00
Philippe Tillet
0ec213547c
[PYTHON][KERNEL] Added benchmarking functionalities for kernels
2019-10-28 00:30:04 -04:00
Philippe Tillet
e11557855f
[PYTHON] [OPS] Added einsum implementation
2019-10-26 22:14:50 -04:00
Philippe Tillet
655f43fb5b
more work
2019-10-26 15:10:19 -04:00
Philippe Tillet
76adcb755a
[PYTHON][EXAMPLES] Tentative support for einsum with transpositions
2019-10-25 19:01:21 -04:00
Philippe Tillet
8bd87fa19d
[TEST][DOT] There seems to be a bug in casting tiles before ternary.
...
Reverting for now
2019-10-25 17:00:53 -04:00
Philippe Tillet
b615af2e7e
[codegen] [generator] fixed issue when tile size is 1 along one or more
...
dimensions
2019-10-25 14:22:28 -04:00
Philippe Tillet
0770ccf537
[codegen] [selection] disassociation prototype
2019-10-25 09:39:46 -04:00
Philippe Tillet
943bf41b5c
[python] [op] added Triton NT einsum
2019-10-21 23:37:39 -04:00
Philippe Tillet
099918b3c0
[python] [ops] added skeleton for einsum op
2019-10-21 18:58:02 -04:00
Philippe Tillet
4b0c43bb7b
[python][example] added test for einsum
2019-10-21 17:13:12 -04:00
Philippe Tillet
b81734553b
[lang] added support for batched matrix multiplication
2019-10-21 15:41:50 -04:00
Philippe Tillet
e827d4f467
[python] [bindings] removed obsolete #include
2019-10-20 20:37:37 -04:00
Philippe Tillet
de6fdd5625
[general] removed useless files and includes
2019-10-20 19:29:48 -04:00
Philippe Tillet
96cba9036a
[tests] [unit] added 1D and 3D reduction test
2019-10-20 17:48:19 -04:00
Philippe Tillet
abe3fbb480
[test] [reduce] added test for 1D reduction
2019-10-20 01:01:53 -04:00
Philippe Tillet
23db500edf
[tests] [common] added reduce.h to common headers
2019-10-19 16:53:48 -04:00
Philippe Tillet
a76efd326d
[selection] [codegen] added reduction
2019-10-19 14:47:16 -04:00
Philippe Tillet
d76c6bc3c7
Merge branch 'master' into auto-coalesce
2019-10-18 16:21:28 -04:00
Philippe Tillet
50efd9c82f
[codegen] [liveness] bugfix in live range computation
2019-10-18 14:54:26 -04:00
Philippe Tillet
cfde3dd766
[codegen] [layout] fixed padding issue for row-major HMMA
2019-10-18 13:42:15 -04:00
Philippe Tillet
b43454c9b7
[codegen] [membar] view do not write to shared memory
2019-10-17 22:38:41 -04:00
Philippe Tillet
cf4fbfefee
[codegen] [selection] no longer using llvm::IRBuilder<>::Insert()
2019-10-17 13:12:37 -04:00
Philippe Tillet
be25e954f6
[codegen] [selection] merged selection into generator visit
2019-10-17 12:55:37 -04:00
Philippe Tillet
f4f70db234
[codegen] [selection] re-arranged file structure
2019-10-17 12:31:26 -04:00
Philippe Tillet
a0182f41dd
more cleaning
2019-10-17 08:17:23 -04:00
Philippe Tillet
a157177267
[codegen] [selection] more cleaning
2019-10-17 00:51:26 -04:00
Philippe Tillet
ae24621825
more cleaning
2019-10-17 00:36:46 -04:00
Philippe Tillet
4bfe998cc8
[codegen] [selection] everything is now implemented with visitor
2019-10-16 18:10:03 -04:00
Philippe Tillet
1b5b76b629
[codegen] [selection] machine layouts now create machine tiles
2019-10-15 16:12:08 -04:00