2 ms·
Radeon RX 7900 XTX is RDNA3 but I wonder if llama.cpp is using the Vulkan matrix instructions wmma and mfma. I have not noticed any remarkable differences betw
by coppsilgold 2y ago
Radeon RX 7900 XTX is RDNA3 but I wonder if llama.cpp is using the Vulkan matrix instructions wmma and mfma.
I have not noticed any remarkable differences between Vulkan and ROCm when using IREE but it's not a turnkey solution yet[1].
[1] <https://github.com/nod-ai/sharktank/blob/main/docs/model_cookbook.md https://github.com/nod-ai/sharktank/blob/main/docs/model_coo...>