3 ms·
H100 based DGX/HGX doesn't use 800 Gbit (it doesn't have the PCI-e bw), it's using 400 per GPU.
by _zoltan_ 3y ago
H100 based DGX/HGX doesn't use 800 Gbit (it doesn't have the PCI-e bw), it's using 400 per GPU.
- latchkey 3y agoI was talking about between nodes. We're planning on bonding 2x400G NICs to get that 800G between nodes. That said, latest 4th gen nvlink is 900G... https://www.nvidia.com/en-us/data-center/nvlink/ https://www.nvidia.com/en-us/data-center/nvlink/ But unless you're sleeping with Jensen, you're not going to see it for 52 weeks+ after you order it.
- _zoltan_ 3y agobetween the GPUs you already have 3.2Tbit/s, plus the 2x400 separately. Pretty sweet. Our lead time hasn't been horrible actually, but I work for a pretty big corp
- latchkey 3y agoIt is amazing to me how it is all about who you know. We just got a higher level contact and magically nvidia nic's just appeared in our BOM.