4 ms·
Hello... Is it possible to use aider with a local model running in LMStudio (or ollama)? From a quick glance i did not see an obvious way to do that... Hopef
by realo 2y ago
Hello...
Is it possible to use aider with a local model running in LMStudio (or ollama)?
From a quick glance i did not see an obvious way to do that...
Hopefully i am totally wrong!
- simonw 2y agohttps://aider.chat/docs/llms/ollama.html https://aider.chat/docs/llms/ollama.html
- anotherpaulg 2y agoThanks for your interest in aider. Yes, absolutely you can work with local models. Here are the docs for working with lmstudio and ollama: https://aider.chat/docs/llms/lm-studio.html https://aider.chat/docs/llms/lm-studio.html https://aider.chat/docs/llms/ollama.html https://aider.chat/docs/llms/ollama.html
- m3kw9 2y agoYes and is easy
- leetharris 2y agoYes absolutely In the left bar there's a "connecting to LLMs" section Check out ollama as an example
- fragmede 2y agoyeah: aider --model ollama_chat/deepseek-r1:32b (or whatever)
- sureglymop 2y agoThis didn't work well for me, no changes are ever made but maybe it's because I'm just using the 14B model.
- manmal 2y agoIn case you are on a 32+GB Mac, you could try deepseek-r1-distill-qwen-32b-mlx in LM Studio. It’s just barely usable speed-wise, but gives useful results most of the time.