3 ms·
Thank you. This is genuinely a valid reason even from a simple consistency perspective. (edit: I think -- after I read some of the links -- I understand why Ol
by A4ET8a8uTh0_v2 1y ago
Thank you. This is genuinely a valid reason even from a simple consistency perspective.
(edit: I think -- after I read some of the links -- I understand why Ollama comes across as less of a hero. Still, I am giving them some benefit of the doubt since they made local models very accessible to plebs like me; and maybe I can graduate to no ollama )
- hodgehog11 1y agoI think this is the thing: if you can use llama.cpp, you probably shouldn't use Ollama. It's designed for the beginner.
- otabdeveloper4 1y agoYou shouldn't use Ollama as a beginner either. It comes with crazy begginer-hostile defaults out of the box.
- A4ET8a8uTh0_v2 1y agoHmm? I would argue against that line of argumentation. It is ridiculously easy to start out of box and working. Once the user starts moving against obvious restrictions resulting from the trade-offs in defaults, they can move on to something more custom. Woulnd't that be the definition of beginner friendly? I am biased since I effectively started with Ollama as my main local llm so take this response for what it is. Still, you got me curious. Which defaults you consider hostile ( not disagreeing; this is pure curiosity )?
- otabdeveloper4 1y ago> Which defaults you consider hostile The infamous Ollama context limits, for one.
- A4ET8a8uTh0_v2 1y agoIt is infamous, but does it really stop anyone from exploring it. Granted, I am an anecdote, but flawed as it is, I would personally argue that the imposed limits are perfectly fine for someone, who is just starting. After all, those can be changed once you get your bearings.