4 ms·
What devices and models are people running locally?
by iovrthoughtthis 17d ago
What devices and models are people running locally?
- stymaar 17d agoQwen 3.6-35B-A3B is surprisingly OK on a medium-range business laptop (Lenovo). A bit slow for agentic coding of course but fine for any chatbot use-case.
- qtqtqt 17d agoAny good models that do not need a dedicated GPU?
- m101 17d agoA MacBook Pro is probably the best bang for your buck. I have a 64gb m4 max, but you’ll run decent models with half that ram I think.