2 ms·
The A100 consumes up to 300W [0]. So in total 2.2 MW for the GPUs. Add the same again for CPUs, storage, networking, and cooling the whole thing and maybe it us
by dmurray 4y ago
The A100 consumes up to 300W [0]. So in total 2.2 MW for the GPUs. Add the same again for CPUs, storage, networking, and cooling the whole thing and maybe it uses 5 MW. About the equivalent of 30 Tesla superchargers, of the 35,000 they operate.
[0] https://www.anandtech.com/show/16792/nvidia-unveils-pcie-version-of-80gb-a100-accelerator-pushing-pcie-to-300-watts https://www.anandtech.com/show/16792/nvidia-unveils-pcie-ver...