4 ms·
This is wrong, NVLink is crucial for tensor parallelism in models for training and in large (>40B param) models for inference.
by ipsum2 3y ago
This is wrong, NVLink is crucial for tensor parallelism in models for training and in large (>40B param) models for inference.