3 ms·

I always see: /set parameter num_ctx <value> Explained but never the follow up: /save <custom-name> So you don't have to do the parameter change every l

I always see: /set parameter num_ctx <value> Explained but never the follow up: /save <custom-name> So you don't have to do the parameter change every load. Is there a better way or is it kind of like setting num_ctx in that "you're just supposed to know"?

sReinwald 2y ago
You can also set OLLAMA_CONTEXT_LENGTH=<tokens> as an environment variable to change ollama's default context length.
- Tepix 2y ago
  I think that will not work if you use the OpenAI compatible API endpoint.
- svachalek 2y ago
  I tried this with ollama run, and it had no effect at all.
  - underlines 2y ago
    that env parameter is brand new, did you update ollama?