4 ms·
Why are you talking price when we are talking local AI? That doesn't make any sense to me. Am I missing something?
by Eupolemos 7mo ago
Why are you talking price when we are talking local AI?
That doesn't make any sense to me. Am I missing something?
- culi 7mo agoYour electricity is free?
- cpburns2009 7mo agoIf you have the hardware to run expensive models, is the cost of electricity much of a factor? According to Google, the average price in the Silicon Valley Area is $0.448 per kWh. An RTX 5090 costs about $4,000 and has a peak power consumption of 1000 W. Maxing out that GPU for a whole year would cost $3,925 at that rate. It's not particularly more expensive than that hardware itself.
- culi 7mo agoAt that point it'd be cheaper to get an expensive subscription to a cloud platform AI product. I understand the case for local LLMs but it seems silly to worry about pricing for cloud-based offerings but not worry about pricing for locally run models. Especially since running it locally can often be more expensive
- seanmcdirmid 7mo agoApple silicon is crazy efficient as well as being comparable to GPUs in performance for max and ultra chips.
- thot_experiment 7mo agofor almost the entire year, yes.
- dirasieb 7mo ago15 missed calls from your local power company