3 ms·
Can people drop a good LocalLlama setup that I can run on M4?
by ridiculous_leke 7mo ago
Can people drop a good LocalLlama setup that I can run on M4?
- giancarlostoro 7mo agoNot sure about LocalLlama, but have you tried LMStudio? If you use Zed it will auto-pickup whatever model you enable on LMStudio. I keep meaning to write a blog post about this for people unaware that you can pair the two pretty easily on a Mac. I mostly use CC but like to test offline models now and then to see how far they've come along.
- ridiculous_leke 7mo agoI use Ollama to run local models but have never used one with CC. Curious what models work best for people.
- giancarlostoro 7mo agoI use Zed with its Claude Code integration, and if I wanna use any other LLM I use LMStudio which is nice on the Mac, and hosts the APIs for it, Zed knows which models are available which is a plus.