3 ms·
A typical LLM might use about 0.1% of CUDA. That's all that would have to be ported to get that LLM to work.
by bryanlarsen 2y ago
A typical LLM might use about 0.1% of CUDA. That's all that would have to be ported to get that LLM to work.
- pjmlp 2y agoWhich is missing the point why CUDA has won. Then again, maybe the goal is getting 0.1% of CUDA market share. /s
- its_down_again 2y agoIn the words of Gilfoyle-- I'll bite. Why has CUDA won?
- pjmlp 2y agoCUDA C++, CUDA Fortran, CUDA Anything PTX, plus libraries, IDE integration, GPU graphical debugging. Coupled with Khronos, Intel, AMD never delivering anything comparable with OpenCL, Apple losing interest after Khronos didn't took OpenCL into the direction they wanted, Google never adopting it favouring their Renderscript dialect.
- imtringued 2y agoNvidia has won because their compute drivers don't crash people's systems when they run e.g. Vulkan Compute. You are mostly listing irrelevant nice to have things that aren't deal breakers. AMD's consumer GPUs have a long history of being abandoned a year or two after release.
- pjmlp 2y agoCUDA C++, CUDA Fortran, CUDA Anything PTX, plus libraries, IDE integration, GPU graphical debugging, aren't only nice to have things.