4 ms·
96% TCO and energy savings for 65 racks eight-way HGX H100 air-cooled versus 1 rack GB200 NLV72 liquid-cooled with equivalent performance on GPT-MoE-1.8T real-t
by nabla9 1y ago
96% TCO and energy savings for 65 racks eight-way HGX H100 air-cooled versus 1 rack GB200 NLV72 liquid-cooled with equivalent performance on GPT-MoE-1.8T real-time inference throughput.
Big if true. Energy and cooling costs can represent up to 30-40% of the total cost of setting up and running an AI data center.
- aurareturn 1y agoCertainly comparing Blackwell's FP4 performance to H100 FP16, no?