4 ms·
Genesiscloud.com mentions „starting at @2.00/hr“ for HGX100 H100.
by Tepix 2y ago
Genesiscloud.com mentions „starting at @2.00/hr“ for HGX100 H100.
- spott 2y agoOnly 200Gbps network per node. The infiniband stuff is 400Gbps per GPU (3.2Tbps per node).
- GC_tris 2y agoEach GPU is connected with 400Gbps. The rest ist just the normal dataplane which is independent from the GPUs. Source: Was personally involved in design of that deployment.
- spott 2y agoGood to know. I went to recheck, because I swore I didn't see anything about that when I looked earlier, but they now say 3.2Tbps infiniband... not sure if they changed it or I was just blind. Thanks!