6 ms·
Ollama is quite a bad example here. Despite popular, it's a simple wrapper and more and more pushed by the app it wraps llama.cpp. Don't understand here the pa
by mehdibl 7mo ago
Ollama is quite a bad example here. Despite popular, it's a simple wrapper and more and more pushed by the app it wraps llama.cpp.
Don't understand here the parallel.
- ekianjo 7mo agoI guess the parallel is "Ollama serve" which provides you with a direct REST API to interact with a LLM.
- sieve 7mo agollama-cpp provides an API server as well via llama-server (and a competent webgui too).
- eleventyseven 7mo agoThis is the vLLM of classic ML, not Ollama.
- kossisoroyce 7mo agoTBVH I didn't think about naming it too much. I defaulted to Ollama because of the perceive simplicity and I wanted that same perceived simplicity to help adoption.