llama.cpp added ROCm linux support a little over a month ago. Details on that can be found in their readme: https://github.com/ggerganov/llama.cpp#hipblas https

llama.cpp added ROCm linux support a little over a month ago. Details on that can be found in their readme: https://github.com/ggerganov/llama.cpp#hipblas https://github.com/ggerganov/llama.cpp#hipblas (no luck for windows users though)