4 ms·
But CUDA kernels are everywhere, not just in high-level frameworks. Look at DeepSpeed, for example, which is used in training LLMs.
by woodson 3y ago
But CUDA kernels are everywhere, not just in high-level frameworks. Look at DeepSpeed, for example, which is used in training LLMs.
- slt2021 3y agoSo what? They can be replaced by amd kernels if there will be adequate tooling support
- deleted 3y ago[deleted]