You pretty much hit the nail on the head, a big limitation is the feeding the GPUs in the first place. Furthermore, all that memory bandwidth is calculated aga

You pretty much hit the nail on the head, a big limitation is the feeding the GPUs in the first place. Furthermore, all that memory bandwidth is calculated against all the cores. So you have to be VERY careful in usage patterns (it doesn't work like a giant CPU). Not to mention how much it costs involved per GB or TB! I have some experience in this area, and where GPU's & database really shine is building (and especially) re-building indexes. Running a database on GPUs isn't going to replace all DBs overnight. But, the hardware does have it's uses; just like improved SIMD on CPU's and NVMe storage, plus developments in networking - Basically look where Intel is going since we're coming to the limits of silicon transistors..