4 ms·
What do you mean by "relatively universal"? This is Cuda only [0] with a promise of a rocm backend eventually. There's only one project I'm aware of that seriou
by eyegor 2y ago
What do you mean by "relatively universal"? This is Cuda only [0] with a promise of a rocm backend eventually. There's only one project I'm aware of that seriously tries to address the Cuda issue in ml [1].
[0] https://github.com/HazyResearch/ThunderKittens?tab=readme-ov-file#installation https://github.com/HazyResearch/ThunderKittens?tab=readme-ov...
[1] https://github.com/vosen/ZLUDA https://github.com/vosen/ZLUDA
- f_devd 2y agoIf you read the article I linked they show that it's entirely based on 16x16 matrices (or "tiles") which is fairly standard across gpus.