5 ms·
And that's exactly why llama.cpp is not usable by casual users. They follow the "move fast and break things" model. With ollama, you just have to make sure you'
by zozbot234 7mo ago
And that's exactly why llama.cpp is not usable by casual users. They follow the "move fast and break things" model. With ollama, you just have to make sure you're getting/building the latest version.
- Eisenstein 7mo agoIts not possible to run the latest model architectures without 'moving fast'. The only thing broken here is that they are trying to use an old version with a new model.
- cyanydeez 7mo agoand Ollama suffered the same fate when wanting to try new models
- Eisenstein 7mo agoWhat fate?
- cyanydeez 7mo agothe impedance mismatch between when models are released and the capability of Ollama and other servers capability for use.
- Eisenstein 7mo agoI'm a bit unsure what that has to do with someone running an outdated version of the program while trying to use a model that is supported in the latest release.