4 ms·
What is the advantage of this over running: ollama run gemma2:2b ?
by schappim 2y ago
What is the advantage of this over running: ollama run gemma2:2b ?
- umtksa 2y agoand I tried both of them and ollama some how handled everything better for gemma2
- mappu 2y agoollama is a thin wrapper over llama.cpp, so i'd pose the opposite question - what does ollama give you over using llama.cpp directly?
- schappim 2y agoModel management, customisable HTTP APIs, monitoring, security features, "parallel requests" (batch processing), no requirement for HF auth etc...
- yjftsjthsd-h 2y agoEase of use. Rather like arduino or like docker vs chroot/jails/zones, there's nothing wrong with just using the underlying tech, but lowering friction has value.