2 ms·
> For the setup price alone of a low-end home lab1, you could buy several years of a paid subscription to one of the AI providers. The power costs would come ou
by yellowapple 2mo ago
> For the setup price alone of a low-end home lab1, you could buy several years of a paid subscription to one of the AI providers. The power costs would come out to around $50-$300 per month, depending on how much inference you’re running: again, the price of a couple more paid subscriptions.
Okay, but I already have multiple computers capable of running local models with acceptable performance, so for me the cost is $0. I suspect that's true for most people of sufficient technical inclination to be interested in and capable of running models on their local machines.
Also, no, the monthly electricity price of even my power-hungriest machines ain't anywhere close to that figure. Hell, at the high end that's more than my power bill for my whole household.
- robotresearcher 2mo agoLet’s put numbers on it. The mean price of electricity for me is about 40c per kWh: about as high as anywhere in the US. There are about 730 hours in a month, and a consumer machine can sustain maybe 500W, so we can spend 0.4 * 0.5 * 730 = 146 dollars on compute power per box unless we start buying special stuff.
- nozzlegear 2mo agoFor my area (nw Iowa) where electricity is about 10¢ per kWh, that'd be like $43.8 ish? In reality much less for me personally with a Mac Studio, since it doesn't go anywhere near 500W