3 ms·
I suspect Ollama is at least partly moving away open source as they look to raise capitol, when they released their replacement desktop app they did so as close
by smcleod 10mo ago
I suspect Ollama is at least partly moving away open source as they look to raise capitol, when they released their replacement desktop app they did so as closed source. You're absolutely right that people should be using llama.cpp - not only is it truly open source but it's significantly faster, has better model support, many more features, better maintained and the development community is far more active.
- parthsareen 10mo agoDesktop app is open-source now.
- calgoo 10mo agoOnly issue I have found with llama.cpp is trying to get it working with my amd GPU. Ollama almost works out of the box, in docker and directly on my Linux box.
- Lapel2742 10mo ago>Only issue I have found with llama.cpp is trying to get it working with my amd GPU. I had no problems with ROCm 6.x but couldn't get it to run with ROCm 7.x. I switched to Vulkan and the performance seems ok for my use cases