Disclosure: I work on Google Cloud (even with Zak sometimes). The DGX-2h is a beast! Don’t parse this as “huh, TPU Pods are about the same as just a few V100s”

Disclosure: I work on Google Cloud (even with Zak sometimes). The DGX-2h is a beast! Don’t parse this as “huh, TPU Pods are about the same as just a few V100s”. The data sheet [1] is probably the easiest to follow, but their writeup is more informative [2]. These are souped up V100s, with awesome networking, which is pretty similar in style to a TPU Pod. So I’d say that they’re both purpose built systems for distributed ML training. The name for the NVIDIA system is even “DGX SuperPOD” :). [1] https://www.nvidia.com/content/dam/en-zz/es_em/Solutions/Data-Center/dgx-2/nvidia-dgx-2h-datasheet.pdf https://www.nvidia.com/content/dam/en-zz/es_em/Solutions/Dat... [2] https://devblogs.nvidia.com/dgx-superpod-world-record-supercomputing-enterprise/ https://devblogs.nvidia.com/dgx-superpod-world-record-superc...