3 ms·
My following post is entirely speculation. NVLink also gives you memory pooling; 8*32GB just baaarely fits the model. NVBus is the public version of an InfiniB
by freeone3000 5y ago
My following post is entirely speculation.
NVLink also gives you memory pooling; 8*32GB just baaarely fits the model. NVBus is the public version of an InfiniBand interconnect allowing for V-RDMA (which people have been doing for years), which would then allow for distributed execution using pydist or Megatron (or DeepSpeed). So it's probably a similar infrastructure to Nvidia's supercomputers, since that's what everyone built before Nvidia started selling them.