3 ms·
Super annoying. I have an RX 6600 XT and can't get ROCm to work on Linux. Vulkan ML however worked perfectly out of the box, so at least I got something. Just
by cokecan 2y ago
Super annoying. I have an RX 6600 XT and can't get ROCm to work on Linux.
Vulkan ML however worked perfectly out of the box, so at least I got something.
Just weird the official thing doesn't work.
- suprjami 2y agoUse the Debian libraries, it works: https://github.com/superjamie/rocswap https://github.com/superjamie/rocswap
- slavik81 2y agoThe caveat being that PyTorch has a lot of dependencies and a couple of them are not yet available in Debian Unstable. For folks wanting to use StableDiffusion, that's a problem. However, the available packages are more than sufficient for llama-cpp as you point out.