3 ms·
Triton is a backend for PyTorch. Lately it is the backend. So it's definitely double digits percentage if not over 50%.
by almostgotcaught 1y ago
Triton is a backend for PyTorch. Lately it is the backend. So it's definitely double digits percentage if not over 50%.
- lairv 1y agoIt's the backend for torch.compile, pytorch eager mode will still use cuBLAS/cuDNN/custom CUDA kernels, not sure what's the usage of torch.compile
- almostgotcaught 1y ago> not sure what's the usage of torch.compile consider that at minimum both FB and OAI themselves definitely make heavy use of the Triton backend in PyTorch.
- cavisne 1y agoDoesn’t triton write its own intermediate language that then compiles to PTX?
- almostgotcaught 1y agoYes and?
- saagarjha 1y agoIt has a fairly standard MLIR pipeline