3 ms·there is nccl, gpudirect, nvlink and so on and so forth.. It is not just matmul on gpus.by emmender 3y agothere is nccl, gpudirect, nvlink and so on and so forth.. It is not just matmul on gpus.