3 ms·

If the local model is served via ollama, there's a default timeout of 10 minutes , which can be adjusted either per-call , or (as I did) in the systemd service

If the local model is served via ollama, there's a default timeout of 10 minutes , which can be adjusted either per-call , or (as I did) in the systemd service environment variables https://docs.ollama.com/faq#how-do-i-keep-a-model-loaded-in-memory-or-make-it-unload-immediately https://docs.ollama.com/faq#how-do-i-keep-a-model-loaded-in-... You didn't specify what was serving your local model.

rvba 3mo ago
Thank you for your reply. I use LM studio (local server), but can switch to a different tool. Do you know how to switch it in LM studio? What I see is that: android studio gives "Error: stream failed" and in LM studio server I see it is still working, then says that client (=android studio) disconnected. So I assumed it was a setting in android studio.
- NortySpock 3mo ago
  Dunno, I have not used either of those. (Had been using zed and ollama, and ollama had plenty of odd defaults that needed fixing) Glancing through the docs, I would be digging down in the config of both Android studio and lm studio for either a TTL or jit auto evict setting, and if you find it, set it to some large number measured in hours? https://developer.android.com/studio/gemini/use-a-local-model https://developer.android.com/studio/gemini/use-a-local-mode... https://lmstudio.ai/docs/developer/core/ttl-and-auto-evict https://lmstudio.ai/docs/developer/core/ttl-and-auto-evict
  - rvba 3mo ago
    I saw those and sadly none of those works not provides solution to "Error: stream failed" that happens like clockwork. I found this one: https://www.jetbrains.com/help/toolbox-app/remote-agent-timeout-machanism.html#configuration https://www.jetbrains.com/help/toolbox-app/remote-agent-time... But it requires me to reinstall android studio because jetbrains toolbox cannot find it... because I installed ir on D: On a side note Android studio atill creates hundred of megabutea of hidden stuff on C:

rvba 3mo ago

Thank you for your reply. I use LM studio (local server), but can switch to a different tool. Do you know how to switch it in LM studio? What I see is that: android studio gives "Error: stream failed" and in LM studio server I see it is still working, then says that client (=android studio) disconnected. So I assumed it was a setting in android studio.

NortySpock 3mo ago
Dunno, I have not used either of those. (Had been using zed and ollama, and ollama had plenty of odd defaults that needed fixing) Glancing through the docs, I would be digging down in the config of both Android studio and lm studio for either a TTL or jit auto evict setting, and if you find it, set it to some large number measured in hours? https://developer.android.com/studio/gemini/use-a-local-model https://developer.android.com/studio/gemini/use-a-local-mode... https://lmstudio.ai/docs/developer/core/ttl-and-auto-evict https://lmstudio.ai/docs/developer/core/ttl-and-auto-evict
- rvba 3mo ago
  I saw those and sadly none of those works not provides solution to "Error: stream failed" that happens like clockwork. I found this one: https://www.jetbrains.com/help/toolbox-app/remote-agent-timeout-machanism.html#configuration https://www.jetbrains.com/help/toolbox-app/remote-agent-time... But it requires me to reinstall android studio because jetbrains toolbox cannot find it... because I installed ir on D: On a side note Android studio atill creates hundred of megabutea of hidden stuff on C: