> Wouldn't it be nice if I could choose more CUDA cores if that's what I needed? Wouldn't it be nice if I could add more dedicated video RAM? How would you ach

> Wouldn't it be nice if I could choose more CUDA cores if that's what I needed? Wouldn't it be nice if I could add more dedicated video RAM? How would you achieve any of that? The single meaningful difference between data rates in normal DDR memory and GDDR is that the latter is designed for signaling where the chips are soldered directly on a pcb with very short traces, whereas the former is designed to accommodate the longer distances and narrower buses necessitated by having socket connections. Any hypothetical new GPU connector would still have to have the memory soldered on the same board as the GPU. (Or, if you are going for the more advanced packaging methods, connected through an interposer or EMIB or something.) > Why does a GPU use PCI-Express still? Because PCI-Express is basically the best anyone can do. It has been rapidly evolved to the point where in the past there was a lot of win by using custom busses, but now everyone just uses PCIe because it's the best available. (And I mean everyone, almost all of the remaining custom buses used in high-performance workloads are basically PCIe with a few restrictions loosened.) Basically the only way you can go up from PCIe is to go wider. And if you do that, what you will likely to do is to make a LGA or PGA style socket format, that talks PCIe.