3 ms·
Nice work! This is interesting to read the comparison between Hidet and Triton in this blog: > Hidet Script vs. Triton: Triton greatly simplifies the CUDA prog
by junrushao1994 3y ago
Nice work! This is interesting to read the comparison between Hidet and Triton in this blog:
> Hidet Script vs. Triton: Triton greatly simplifies the CUDA programming by introducing the tile-based programming model where the parallel execution unit is thread blocks instead of threads. However, this simplification also prevents the tensor program developers from manipulating the fine-grained computation and memory resources (e.g., warps, shared memory) in their preferred ways. It would be challenging to implement an optimization that requires fine-grained control of these resources using Triton if it has not been implemented by the Triton compiler itself. Hidet Script, on the other hand, simplifies tensor programming while still enabling users to implement their own optimizations with extensive flexibility. It’s worth noting that the more granular control of Hidet Script also brings added complexity compared to Triton.