With this setup, you get one GPU that runs with 16 lanes (and as you mentioned, three that run with 8). Bottleneck depends on the workload. If you're training

With this setup, you get one GPU that runs with 16 lanes (and as you mentioned, three that run with 8). Bottleneck depends on the workload. If you're training a small/fast network, data bandwidth is a real problem. That being said, for most cases, a workstation build that provides every GPU with 16 lanes is far less cost effective.