3 ms·
How are you getting 5kW? NVIDIA claim 10.2kW for a DGX H100 pod. https://docs.nvidia.com/dgx/dgxh100-user-guide/introduction-to-dgxh100.html#:~:text=130.45%20k
by dagmx 2y ago
How are you getting 5kW?
NVIDIA claim 10.2kW for a DGX H100 pod. https://docs.nvidia.com/dgx/dgxh100-user-guide/introduction-to-dgxh100.html#:~:text=130.45%20kg)%20max-,Power%20Specifications,distribution%20of%20the%20power%20load.&text=10.2%20kW%20max https://docs.nvidia.com/dgx/dgxh100-user-guide/introduction-....
Your point still stands though where power is a fraction of the cost.
The bigger issue is power + cooling and how many units are needed to train the better models.
- throwup238 2y agoServes me right for doing back of napkin math instead of just looking it up. The SXM4 A100s I use have a TDP of 400W and I hadn't realized the higher power H100 are up to 800W.
- deleted 2y ago[deleted]