4 ms·
Why are you paying $300/day to run a local model? The whole point is that you run them on a machine you already own.
by nozzlegear 6mo ago
Why are you paying $300/day to run a local model? The whole point is that you run them on a machine you already own.
- himata4113 6mo agoNone of the models advanced enough to replace frontier will be able to run on your machine for any forseeable future or at a reasonable speed. 5tok/s is not acceptable. To run deepseek v4 class model, you would need to spend $120k just in gpus.