3 ms·
Unless there are some really, really major shortcuts found in inference, then it's always going to be hard to run a really great model locally. The costs of the
by qingcharles 7mo ago
Unless there are some really, really major shortcuts found in inference, then it's always going to be hard to run a really great model locally. The costs of the PC + electric will usually be crazy compared to a $20/mo Claude sub.
- 3836293648 7mo agoBut that $20/month is still heavily subsidised. You have to compare to the API costs, not the direct subscription.