3 ms·
Definitely the right way to look at things. > If you take the "350,000" H100s that Facebook wants by EOY, each of those can do 700W Plus ~500W for cooling
by xnx 3y ago
Definitely the right way to look at things.
> If you take the "350,000" H100s that Facebook wants by EOY, each of those can do 700W
Plus ~500W for cooling
- pclmulqdq 3y agoLess than a 1:1 ratio here is an extremely efficient datacenter. The heat has to get out of the building, not just off the chip.
- xnx 3y agoOh, wow. I didn't know it was that bad. Google advertises a PUE of 1.1: https://www.google.com/about/datacenters/efficiency/ https://www.google.com/about/datacenters/efficiency/
- pclmulqdq 3y agoJust to clarify, PUE of 1.1 means 10% power waste not spent on computing. However, Google datacenters are extremely efficient, and they design everything end-to-end for efficiency. A normal datacenter with less efficient cooling, less efficient power delivery, less efficient buildings, etc. easily adds up to a lot more wasted power.