2 ms·
I think NVLink is a memory interconnect more like NUMAlink, UPI, or Infinity Fabric. AFAIK GPUs can transparently access each other's memory over NVLink (probab
by wmf 4y ago
I think NVLink is a memory interconnect more like NUMAlink, UPI, or Infinity Fabric. AFAIK GPUs can transparently access each other's memory over NVLink (probably at cache line granularity) while RDMA protocols require explicitly copying memory (usually in larger chunks) before accessing it.