3 ms·
SLI isn't used at all for CUDA. if you meant NVLink, it's apparently not useful at small scales - I think the PCIe lanes are enough.
by sterlind 3y ago
SLI isn't used at all for CUDA. if you meant NVLink, it's apparently not useful at small scales - I think the PCIe lanes are enough.
- ipsum2 3y agoThis is wrong, NVLink is crucial for tensor parallelism in models for training and in large (>40B param) models for inference.