3 ms·
Unfortunately "AMD" and "easy" are mutually exclusive right now. You can be a linux/python dev and set up rocm. Or you can run llama.cpp's very slow OpenCL ba
by brucethemoose2 3y ago
Unfortunately "AMD" and "easy" are mutually exclusive right now.
You can be a linux/python dev and set up rocm.
Or you can run llama.cpp's very slow OpenCL backend, but with easy setup.
Or you can run MLC's very fast Vulkan backend, but with no model splitting and medium-hard setup.