4 ms·
Are there local models that are anywhere near as good at coding as opus 4.6?
by locusofself 6mo ago
Are there local models that are anywhere near as good at coding as opus 4.6?
- jasonjmcghee 6mo agoPeople will insist otherwise, but I haven't seen anything close to sonnet 4.6 that can be run locally.
- Incipient 6mo agoI don't think anyone can honestly say a huge frontier model is actually going to be matched by something running on 64gb locally?
- jasonjmcghee 6mo agoI have read many comments saying Qwen3.5 various ~30B models, Gemma 4 ~30B models and now Qwen3.6 "better than sonnet". I don't know how large sonnet and opus are but the rumor is 1T and 5T respectively.
- urig 6mo agoYou don't have to use the most recent bleeding edge model to succeed. A local FOSS coding agent coupled with a reasonably priced LLM could yield the optimal ROI.
- kadoban 6mo agoNot really. Qwen 3.5 and Gemma and a couple of others are quite good though, and the quants are _very_ runnable on a good gpu.