4 ms·
You are not looking at the full economics of the situation. There are very few data centers left that can do 45kW+ rack density, which translates to 32 H100/MI
by latchkey 2y ago
You are not looking at the full economics of the situation.
There are very few data centers left that can do 45kW+ rack density, which translates to 32 H100/MI300x GPUs in a rack.
Most datacenters, you're looking at 1 or 2 boxes of 8 GPU, a rack. As a result, it isn't just the price of power, it is whatever the data center wants to charge you.
Then you factor in cooling on top of that...