3 ms·
They had 32 servers in the cluster, each with 8 P100 GPUs. Each GPU was one "worker" in their parlance. ("How to train ResNet-50 in one hour on two million do
by dgacmu 9y ago
They had 32 servers in the cluster, each with 8 P100 GPUs. Each GPU was one "worker" in their parlance.
("How to train ResNet-50 in one hour on two million dollars of hardware." :-)