4 ms·
> The NVIDIA GB200/GB300 NVL72 rack-scale system consumes approximately 120 kW to 135 kW (TDP), with peak power potentially reaching 155 kW depending on the wor
by htrp 6mo ago
> The NVIDIA GB200/GB300 NVL72 rack-scale system consumes approximately 120 kW to 135 kW (TDP), with peak power potentially reaching 155 kW depending on the workload.
Widely acknowledged to be the baseline for running a frontier tier model at scale.
Pedantic corrections notwithstanding, Dave does a great job of highlighting the fact that faster code-gen without more robust review processes just leads to unfinished AI code that is too complex for a human reviewer to understand and confidently deploy.