4 ms·
You should be comparing the value you get. If you get as much value from a local model as a hosted one, the size difference doesn’t matter.
by dwb 11d ago
You should be comparing the value you get. If you get as much value from a local model as a hosted one, the size difference doesn’t matter.
- no-name-here 11d ago>>> Claude Code is $100+ or else be constantly throttled >> Is your comparison against a similar size model? Or shouldn't you be comparing it against the cost of a hosted model matching the one you’re using locally? > You should be comparing the value you get But the GP commenter specifically compared the cost of solutions such as Claude Code against a 32 GB model. If they are going to compare cost, they should compare to the cost of a hosted ~32 GB model. Or if privacy trumps everything for them, then just say that and don't bother comparing costs of incredibly disparate solutions, as Claude Code costing $100+ a month was a red herring if they're happy with 32 GB model output - they could have compared to a far cheaper option that matched their local model's quality. It would be like someone saying they were able to buy a bike to get to work, saving them $x million compared to buying a Bugatti. When really, if they're going to compare cost they should compare to a cheap car, or not bring up the cost of an expensive car at all if exercise trumps everything else for them.