3 ms·
Make something better, then. (I'm not being dismissive, I really genuinely mean it - please do) I don't know who is behind Ollama and don't really care about t
by slimsag 3y ago
Make something better, then. (I'm not being dismissive, I really genuinely mean it - please do)
I don't know who is behind Ollama and don't really care about them. I can agree with your disgust for VC 'open source' projects. But there's a reason they become popular and get investment: because they are valuable to people, and people use them.
If Ollama was just a wrapper over llama.cpp, then everyone would just use llama.cpp.
It's not just marketing, either. Compare the README of llama.cpp to the Ollama homepage, notice the stark contrast of how difficult getting llama.cpp connected to some dumb JS app is compared to Ollama. That's why it becomes valuable.
The same thing happened with Docker and we're just now barely getting a viable alternative after Docker as a company imploded, Podman Desktop, and even then it still suffers from major instability on e.g. modern macs.
The sooner open source devs in general learn to make their projects usable by an average developer, the sooner it will be competitive with these VC-funded 'open source' projects.
- behnamoh 3y agollama.cpp already has OpenAI compatible API. It takes literally one line to install it (git clone and then make). It takes one line to run the server as mentioned on their examples/server README. ./server -m <model> <any additional arguments like mmlock>
- homarp 3y ago>notice the stark contrast of how difficult getting llama.cpp connected to some dumb JS app is compared to Ollama. Sorry, I'm new to ollama 'ecosystem'. From llama.cpp readme, I ctrl-F-ed "Node.js: withcatai/node-llama-cpp" and from there, I got to https://withcatai.github.io/node-llama-cpp/guide/ https://withcatai.github.io/node-llama-cpp/guide/ Can you explain how ollama does it 'easier' ?