3 ms·
Yeah, I really should know. But I'm using whatever ollama gave me by default, which probably isn't optimal.
by 3836293648 3mo ago
Yeah, I really should know. But I'm using whatever ollama gave me by default, which probably isn't optimal.
- kgeist 3mo agoOllama uses 4 bit quants and a very short context window by default. It can easily break on anything more complex than a simple chat.
- 3836293648 3mo agoOh, the context window I overrode immediately, the default one can't even reach my prompt in opencode, it's pushed out by all the pre- and post-amble. But I should probably try something less compressed next time I bother.