2 ms·
Yeah. Meta has internally widely shared the expected size of a new very large cluster they are building in 2024 and from the number of H100s or whatever you ca
by loeg 3y ago
Yeah. Meta has internally widely shared the expected size of a new very large cluster they are building in 2024 and from the number of H100s or whatever you can probably calculate a reasonable low estimate on power draw (there will be other machines to support the compute, e.g., storage). I don't know that it's public yet so I won't say the exact size but I expect it to be leaked or spoken about publicly shortly anyway. It's a lot of MW. They are semi-joking talking about building nuclear reactors to power future DCs.