3 ms·
I wonder to what extent vulkan compute could be used for this. Of course, it is only an option on their RDNA GPUs since CDNA is not for graphics, even though th
by ryao 2y ago
I wonder to what extent vulkan compute could be used for this. Of course, it is only an option on their RDNA GPUs since CDNA is not for graphics, even though that is the G in GPU.
- Fronzie 2y agoThere has been some testing within llama.cpp, which supports both Vulkan and ROCM-Blas. When it works, the latter is about 2x faster than the Vulkan version.
- pjmlp 2y agoUnless it provides the polyglot capabilities of CUDA, and related IDE and graphical debugging capabilities, not really.