3 ms·
> 5 kW to work with per cabinet have my expectations been shot by reading too much about Nvidia's latest and greatest, or does this seem quite low?
by kristjansson 9mo ago
> 5 kW to work with per cabinet
have my expectations been shot by reading too much about Nvidia's latest and greatest, or does this seem quite low?
- shrubble 9mo agoThat’s standard practice in many data centers; but you can often pay more to get more amps delivered to your rack.
- arjie 9mo agoNo, your expectations are not wrong. I'm a small business. A fully stacked AI/GPU cabinet is multiples of this. A single GH200 based server will have 2x2.7 kW power supplies in a 1U form factor. As you can imagine, I am not running a cabinet full of such servers. But you don't need AI power requirements to do normal software. And there's lots of normal software to do!
- tuetuopay 9mo agoHaving worked in the space, 6kVA is the norm from 10-15 years ago, 12kVA is the standard for regular compute workloads. With HPC/AI all bets are off though.