3 ms·

Ollama doesn’t even have a way to customize the context size per model and persist it. LM studio does :)

• Anaphylaxis 1y ago
  This isn't true. You can `ollama run {model}`, `/set parameter num_ctx {ctx}` and then `/save`. Recommended to `/save {model}:{ctx}` to persist on model update
  • truemotive 1y ago
    This can be done with custom Modelfiles as well, I was pretty bent when I found out that 2048 was the default context length. https://ollama.readthedocs.io/en/modelfile/ https://ollama.readthedocs.io/en/modelfile/
  • zackify 1y ago
    As of 2 weeks back if I did this, it would reset back the moment cline made an api call. But lm studio would work correctly. I’ll have to try again. Even confirmed cline was not overriding num context