3 ms·
You can also set OLLAMA_CONTEXT_LENGTH=<tokens> as an environment variable to change ollama's default context length.
by sReinwald 2y ago
You can also set
OLLAMA_CONTEXT_LENGTH=<tokens>
as an environment variable to change ollama's default context length.
- Tepix 2y agoI think that will not work if you use the OpenAI compatible API endpoint.
- svachalek 2y agoI tried this with ollama run, and it had no effect at all.
- underlines 2y agothat env parameter is brand new, did you update ollama?