5 ms·
None of your comment writes about why CUDA is so special compared to OpenCL or Metal. Anybody who has worked with them knows that it's basically the same. Opt
by xiphias2 3y ago
None of your comment writes about why CUDA is so special compared to OpenCL or Metal.
Anybody who has worked with them knows that it's basically the same.
Optimizing kernels for all architectures and all models is a hard problem as there are lot of cases to handle, but getting good utilization for a particular model on a particular architecture (like MI300 / Mixtral) is not that hard.
- nazka 3y ago> None of your comment writes about why CUDA is so special compared to OpenCL or Metal. OP and OP’s OP never frame it about that. But you can still get the answer you are looking for from their answers.