2 ms·

I can't seem to find it anywhere but what is the interconnect between servers being used? NVLink is used internally for GPU to GPU communication within a single

I can't seem to find it anywhere but what is the interconnect between servers being used? NVLink is used internally for GPU to GPU communication within a single box...correct? But this sounds like it takes a cluster of 32 of their 8 GPU Big Basin boxes.

pietern 9y ago
Interconnect between the servers is 50 Gbit Ethernet (see section 4 of the paper).
Ferofluid 9y ago
Something similar to Infiniband