3 ms·
Don't forget about energy usage, you'll probably never break even vs same model on openrouter.
by neuroticnews25 2mo ago
Don't forget about energy usage, you'll probably never break even vs same model on openrouter.
- jurgenburgen 2mo agoIf you can’t do it cheaper on your own hardware it does make you wonder how much of the cost of inference those large LLM providers are eating? Datacenter hardware isn’t magic.
- petu 2mo agoDatacenter hardware can batch at large scale, probably over 90% more energy efficient per token than a MacBook.
- flaunf221 2mo agoYour personal hardware probably isn't running useful tasks 24/7. If you spend 60% of your 8h work day on full on agentic work, then your hardware is paying off for itself only 20% of available time.
- Der_Einzige 2mo agoDatacenter hardware might as well be magic compared to consumer. "Oh the F35 isn't magic compared to my M16 bro!"