4 ms·
At a certain point the energy starts to cost more than renting some GPUs.
by HPsquared 8mo ago
At a certain point the energy starts to cost more than renting some GPUs.
- vardalab 8mo agoYeah, that is hard to argue with because I just go to OpenRouter and play around with a lot of models before I decide which ones I like. But there's something special about running it locally in your basement
- dotancohen 8mo agoI'd love to hear more about this. How do you decide that you like a model? For which use cases?
- fc417fc802 8mo agoAren't decent GPU boxes in excess of $5 per hour? At $0.20 per kWhr (which is on the high side in the US) running a 1 kW workstation 24/7 would work out to the same price as 1 hour of GPU time. The issue you'll actually run into is that most residential housing isn't wired for more than ~2kW per room.