3 ms·
I don't believe the pricing is in the same ballpark. There's also other differences, such as port counts. AFAICT Spectrum switches at 400Gbps have up to 128 p
by charleshn 2y ago
I don't believe the pricing is in the same ballpark.
There's also other differences, such as port counts.
AFAICT Spectrum switches at 400Gbps have up to 128 ports whereas equivalent Infiniband NDR Quantum only have 64 [0].
When building clusters of 32K+ GPUs the network cost, power, transceivers etc start to add up.
[0] https://www.semianalysis.com/p/100000-h100-clusters-power-network https://www.semianalysis.com/p/100000-h100-clusters-power-ne...
- _zoltan_ 2y agoWith IB (Quantum X800) you have 72x physical OSFP ports that can do 144 ports. Each electrical lane runs at 200G-PAM4, so it's 144x(4x200G-PAM4). With the SN5600 for Ethernet (Spectrum-X), which is 64 physical ports, you're running each port at 8x100G-PAM4).
- charleshn 2y agoIs the Quantum X800 generally available now? Looks like it was announced in March. The SN5600 was released last year on the other end.