2 ms·
Why is cuda sub-optimal compared to SPIR-V? I don't think I know the internals enough to understand if it's supposed to be obvious why one is better than the ot
by embedding-shape 1y ago
Why is cuda sub-optimal compared to SPIR-V? I don't think I know the internals enough to understand if it's supposed to be obvious why one is better than the other.
I'm currently sitting and learning cuda for ML purposes, so happy to get more educated :)
- jb1991 1y agoJust depends on how the manufacturer of the GPU handles code written in different languages. For example, what level of API access, what level of abstraction, and how is the source compiled i.e. how optimized is it. For example, on an apple GPU, you’ll see benchmarks that openCL and metal can vary depending on the tasks.
- embedding-shape 1y agoRight, but that'd depend a lot on the context, task, hardware and so on. What parent said seemed more absolute and less relative, almost positing it as there is no point in using cuda (since it's "sub-optimal" and people should use SPIR-V obviously. I was curious in the specifics about that.
- sigbottle 1y agoI mean, nvidia exposes some pretty low level primitives, and you can always fiddle with the PTX as deepseek did.