3 ms·
> Ollama's default context length is frustratingly short in the era of 100k+ context windows. Nobody uses Ollama as is. It's a model server. In clients you can
by ekianjo 1y ago
> Ollama's default context length is frustratingly short in the era of 100k+ context windows.
Nobody uses Ollama as is. It's a model server. In clients you can specify the proper context lengths. This has never been a problem.
- prophesi 1y agoFor sure, though it's tripped me up a few times for clients that don't pass in a reasonable context length with each call.