4 ms·
The comment is about smaller models
by ipaddr 5mo ago
The comment is about smaller models
- gruez 5mo agoRight, but what are you going to do with small models? If your time is worth anything at all you'd pay for the $100 claude code/codex pro subscription, rather than fumbling around with the models quantized enough to fit on your mac.
- ret32f 5mo agoIf small models keep improving for specific purposes and larger models have diminishing returns, then what? E.g. I can see a world where you have a local model that is specialised just for producing code.
- mhitza 5mo agoIf you're building agentic processes (harnesses) for business processes local models are a great way to do that, while keeping your data, and any personal data, private. If you're vibe coding a codex/claude subscription makes more sense as a more polished experience. I don't vibe code, but I use self hosted models with codex for code review and snippet generation.
- 20after4 5mo ago$100 isn't going to buy you much access to claude code when they start charging a profitable fee for using it.