4 ms·
>Ollama refuses to work with my RX 570 from 2019 but llama.cpp supports it via Vulkan. That's a bit odd given ollama utilizing llama to do the inference...
by Havoc 1y ago
>Ollama refuses to work with my RX 570 from 2019 but llama.cpp supports it via Vulkan.
That's a bit odd given ollama utilizing llama to do the inference...
- LorenDB 1y agoSee recent discussion about this very topic: https://news.ycombinator.com/item?id=42886680 https://news.ycombinator.com/item?id=42886680
- DiabloD3 1y agoIt isn't odd at all. Ollama uses an ancient version of llama.cpp, and was originally meant to just be a GUI frontend. They forked, and then never resynchronized... and now lack the willpower and technical skill to achieve that. Ollama is essentially a dead, yet semi-popular, project with a really good PR team. If you really want to do it right, you use llama.cpp.