3 ms·
Right, but what are you going to do with small models? If your time is worth anything at all you'd pay for the $100 claude code/codex pro subscription, rather t
by gruez 6mo ago
Right, but what are you going to do with small models? If your time is worth anything at all you'd pay for the $100 claude code/codex pro subscription, rather than fumbling around with the models quantized enough to fit on your mac.
- ret32f 6mo agoIf small models keep improving for specific purposes and larger models have diminishing returns, then what? E.g. I can see a world where you have a local model that is specialised just for producing code.
- mhitza 6mo agoIf you're building agentic processes (harnesses) for business processes local models are a great way to do that, while keeping your data, and any personal data, private. If you're vibe coding a codex/claude subscription makes more sense as a more polished experience. I don't vibe code, but I use self hosted models with codex for code review and snippet generation.
- 20after4 6mo ago$100 isn't going to buy you much access to claude code when they start charging a profitable fee for using it.