3 ms·
Only 200Gbps network per node. The infiniband stuff is 400Gbps per GPU (3.2Tbps per node).
by spott 2y ago
Only 200Gbps network per node.
The infiniband stuff is 400Gbps per GPU (3.2Tbps per node).
- GC_tris 2y agoEach GPU is connected with 400Gbps. The rest ist just the normal dataplane which is independent from the GPUs. Source: Was personally involved in design of that deployment.
- spott 2y agoGood to know. I went to recheck, because I swore I didn't see anything about that when I looked earlier, but they now say 3.2Tbps infiniband... not sure if they changed it or I was just blind. Thanks!