Yes, I can confirm this is the case (pun intended). I've been speccing out GPU machines for molecular simulation, and any way you slice it, the actual GPUs acco

Yes, I can confirm this is the case (pun intended). I've been speccing out GPU machines for molecular simulation, and any way you slice it, the actual GPUs account for less than 50% of your total cost, as long as you're looking at GTX class cards. The other issue with 8 GPU machines, which tend to use dual CPU motherboards to have enough PCIe lanes, is that you pay a serious performance penalty for communication between GPUs attached to different CPUs (over QPI). It's so bad that I've seen several standalone 8 GPU systems using FDR Infiniband (with GPUdirect RDMA) to communicate internally on the machine. Which is of course bloody expensive. If it suits your workload, having two separate 4 GPU machines is better and cheaper than a single 8 GPU machine.