7 ms·
So this replaces triton for LLMs or?
by lmeyerov 2y ago
So this replaces triton for LLMs or?
- aabhay 2y agoThis is very narrowly focused on LLMs, whereas triton is still useful for running all kinds of ML models. In practice, Triton is a very poor choice for LLMs specifically because it has none of the required non negotiable features like KV caching built in.
- changtimwu 2y agosame question here. Just asked Grok for a comparsion https://grok.com/share/bGVnYWN5_fa210574-f27b-45ae-9d95-19edb5657014 https://grok.com/share/bGVnYWN5_fa210574-f27b-45ae-9d95-19ed...