5 ms·
Is there at good resource that describes the impact of bandwidth and latency between GPUs? I assume that it's completely impractical to train on distributed sy
by marshray 3y ago
Is there at good resource that describes the impact of bandwidth and latency between GPUs?
I assume that it's completely impractical to train on distributed systems?