3 ms·
Where does this "10-50" figure come from? A quick google search says a H100 draws 700 W, while a 3080 draws 320 W. AI provides tangible value to businesses and
by elpocko 1y ago
Where does this "10-50" figure come from? A quick google search says a H100 draws 700 W, while a 3080 draws 320 W.
AI provides tangible value to businesses and private users beyond mere entertainment. We'll see how much power it consumes in the future, and where that power comes from.
- rybosworld 1y agoI did the math in previous comment that you already replied too.. "The GPU's used for AI have significantly higher utilization rates than gaming GPU's... Here's some napkin math: H100: 61% utilization / 700W ~ 3.7MW/year RTX 3080: 10% utilization / 320W ~ 0.27MW/year" H100 uses at least 10x as much power as a 3080 over it's life time. And most gamers aren't playing on 3080's.
- coliveira 1y agoThe difference here is between potential energy use and actual energy use. AI chips as well as other server chips are in use most of the time. But if I sell 1 billion gaming chips, these chips will be in use a small fraction of the time.