12 ms·
>faster than llama cpp in all of the use cases What's your deliberate, well-thought roadmap for achieving adoption similar to llama cpp?
by ewuhic 1y ago
>faster than llama cpp in all of the use cases
What's your deliberate, well-thought roadmap for achieving adoption similar to llama cpp?
- pants2 1y agoProbably getting acquired by Apple :)
- khurs 1y agoOllama is the leader isn't it? Brew stats (downloads last 30 days) Ollama - 28,232 Lama.cpp - 7,826
- DiabloD3 1y agoOllama isn't an inference engine, its a GUI slapped onto a perpetually out-of-date vendored copy of Llama.cpp underneath. So, if you're trying to actually count LLama.cpp downloads, you'd combine those two. Also, I imagine most users on OSX aren't using Homebrew, they're getting it directly from the GH releases, so you'd also have to count those.
- imtringued 1y agoActually, ollama has stopped using llama.cpp and is using ggml directly nowadays.