3 ms·
Is this from 2024? It mentions "With global data center demand at 60 GW in 2024" Also, there is no mention of the latest-gen NVDA chips: 5 RNGD servers gener
by nycdatasci 9mo ago
Is this from 2024? It mentions "With global data center demand at 60 GW in 2024"
Also, there is no mention of the latest-gen NVDA chips: 5 RNGD servers generate tokens at 3.5x the rate of a single H100 SXM at 15 kW. This is reduced to 1.5x if you instead use 3 H100 PCIe servers as the benchmark.