10 ms·
It'd be easy enough for ollama alternatives -- they just need to make a CLI front end that lets you run a model with reasonable efficiency without passing any f
by dpkirchner 1y ago
It'd be easy enough for ollama alternatives -- they just need to make a CLI front end that lets you run a model with reasonable efficiency without passing any flags. That's really ollama's value, as far as I can tell.
- otabdeveloper4 1y agoOllama itself doesn't pass that test. (Broken context settings, non-standard formats and crazy model names.)
- dpkirchner 1y agoI haven't experienced this personally, but I have stuck with pretty mainstream models like llama, gemma, deepseek, etc.