2 ms·
> You just copy data over PCIe AFAIK this only happens directly over PCIe if using hacked drivers with p2p enabled (I think tinygrad/tinybox provided these dri
by ai-christianson 2y ago
> You just copy data over PCIe
AFAIK this only happens directly over PCIe if using hacked drivers with p2p enabled (I think tinygrad/tinybox provided these drivers initially.)
Otherwise, data goes through system bus/CPU first. `nvidia-smi topo -m` will show how the GPUs are connected.