3 ms·
Ollama supports many radeons now. And I guess llama.cpp does too, after all it's what ollama uses as backend.
by wkat4242 3y ago
Ollama supports many radeons now. And I guess llama.cpp does too, after all it's what ollama uses as backend.
- p1esk 3y agoPyTorch (the underlying framework of HF) supports AMD as well, though I haven’t tried it.