3 ms·
This is kind of what nvswitch does, albeit in a proprietary architecture. All 16 GPUs in an NVSwitch can see the memory space of all others, and any reads/write
by shaklee3 7y ago
This is kind of what nvswitch does, albeit in a proprietary architecture. All 16 GPUs in an NVSwitch can see the memory space of all others, and any reads/writes are transparently performed on the correct GPU. This effectively gives a 512GB address space of HBM2 memory.
- namibj 7y agoBetter: this works between/towards POWER 9 sockets, including knowing to execute atomics right at the destination.