3 ms·
Why ollama, why not llamacpp? The real effort is done by llamacpp, ollama is unnecessary layer on top of it and cashing in investor money. This behavior is tot
by v3ss0n 2y ago
Why ollama, why not llamacpp? The real effort is done by llamacpp, ollama is unnecessary layer on top of it and cashing in investor money.
This behavior is totally unacceptable and I am boycotting ollama and every ollama based stuff. I am not going to use ollama in my client projects anymore too.
- tyho 2y agoWhat's funny is that ollama just runs the llama.cpp example http server on a random port under the hood and proxies requests to it, it doesn't even link against llama.cpp
- v3ss0n 2y agoYeah they intrusively listen on a port. It is security redflag.
- jerrygenser 2y agoYep, and the only acknowledgement to llama.cpp is that llama.cpp is a "supported backend" (see last page of their GitHub repo readme) And the acknowledgement was only added after community outcry. If not for that they would have kept on as if llama.cpp didn't exist. Implying ollama has other back ends which it does not.
- rvz 2y agoWaiting until ollama announces that they are raising money through VCs. Just like Keybase, Bitwarden, Element, ggml also did.
- v3ss0n 2y agoWe as a community need to rise up awareness that llamacpp can be used as easily as ollama. Another thing is ollama models are hosted on non-open infra service.
- deleted 2y ago[deleted]
- iserdalko 2y agoThe Genkit framework just launched and it has open plugin API. You can already find support for groq, openai, anthropic... I don't think the answer to your question ("Why ollama, why not llamacpp?") really matters (maybe only out of curiosity), but practically if you want llamacpp support someone will probably add it very shortly... It's open-source.