4 ms·
This is wrong because local models are very expensive, just as expensive as the frontier. It would cost me $300 in normal deepseek v4 pricing (non discounted)
by himata4113 5mo ago
This is wrong because local models are very expensive, just as expensive as the frontier.
It would cost me $300 in normal deepseek v4 pricing (non discounted) PER DAY, but I get it all for $500 worth of subscriptions.
- nozzlegear 5mo agoWhy are you paying $300/day to run a local model? The whole point is that you run them on a machine you already own.
- himata4113 5mo agoNone of the models advanced enough to replace frontier will be able to run on your machine for any forseeable future or at a reasonable speed. 5tok/s is not acceptable. To run deepseek v4 class model, you would need to spend $120k just in gpus.