3 ms·
I say let Jim Keller show us all how it's done, as he's often done. Let him convince AMD (with their own interconnect and not specially on lead in Ethernet thes
by touisteur 3y ago
I say let Jim Keller show us all how it's done, as he's often done. Let him convince AMD (with their own interconnect and not specially on lead in Ethernet these days, maybe with Xilinx or Pensando but I haven't seen any serious integration in the road map?), Intel (Xe-Link on GPUs? Ethernet on Gaudi, both unobtainium? And they stopped working on their actual lead in switching/Ethernet with Tofino, WTAF BTW) and whoever else is shipping accelerator hardware to go full ethernet and maybe there's something.
But why would NVIDIA do anything to share this moat? Or even risk to have their whole ecosystem go glitchy and buggy with other hardware vendors? They invested heavily, very heavily, in network tech and did the whole integration (nccl, gpudirect, and even simple memcopy works fine with NVLINK without futzing with actual Ethernet/IP stacks) at a moment where everyone was fucking around either building GPUs back from scratch or buying and dumping good tech? If there was an actually competitive alternative, I could see Jensen have a look but I don't see it right now.