4 ms·
While not all "languages" persay, I am excited about the various ML compilation efforts: https://github.com/merrymercy/awesome-tensor-compilers https://github.
by brucethemoose2 3y ago
While not all "languages" persay, I am excited about the various ML compilation efforts:
https://github.com/merrymercy/awesome-tensor-compilers https://github.com/merrymercy/awesome-tensor-compilers
Modern ML training/inference is inefficient, and lacks any portability. These frameworks are how that changes...
As random examples, TVM runs LLaMA on Vulkan faster than PyTorch CUDA, and AITemplate almost doubles the speed of Stable Diffusion. Triton somewhat speeds up PyTorch training in the few repos that use it now, and should help AMD hardware even more than Nvidia.