2 ms·
> The difference between running a 3090 at x16 PCIE 3.0 vs x16 PCIE 4.0 is negligible This is very wrong for communication intensive workloads like large model
by lostmsu 4y ago
> The difference between running a 3090 at x16 PCIE 3.0 vs x16 PCIE 4.0 is negligible
This is very wrong for communication intensive workloads like large model training. If communication is your bottleneck (which is very possible in that case), PCIE 4.0 is 2x faster than PCIE 3.0.
- timtom39 4y agoYou benchmarked? On what platform? Training what? Can you link to this? Or are you just looking at theoretical? In my experience, for what the 3090 offers, it is not really an issue unless you start using birutificaiton.
- lostmsu 4y agoI did not benchmark. This is theoretical and talks about specific conditions: when your training is bottlenecked on communication between GPUs. PCIE 4.0 is exactly 2x bandwidth, and PCIE 5.0 is another 2x more.