2 ms·
There are "only" 32 GPUs in the cluster, with 8 workers per GPU.
by shezi 9y ago
There are "only" 32 GPUs in the cluster, with 8 workers per GPU.
- dgacmu 9y agoThey had 32 servers in the cluster, each with 8 P100 GPUs. Each GPU was one "worker" in their parlance. ("How to train ResNet-50 in one hour on two million dollars of hardware." :-)