I think the key reason why the world will move a lot of stuff that “already exists on CPUs” to GPUs is not that we’re porting existing code, it’s that GPU accel

I think the key reason why the world will move a lot of stuff that “already exists on CPUs” to GPUs is not that we’re porting existing code, it’s that GPU acceleration is a meta-trend that is disrupting all highly technical fields. It started much earlier decades ago in gaming and video. It then moved to grid and scientific computing. It has now fully revolutionized AI. The returns on better CPU code are much less than the returns on GPU code in the medium term as many of these trends in graphics, scientific computing, AI are mutually reinforcing. When 90% of your pipeline runs of GPU then the last 10% might as well too. There are obviously tons of small things that require CPU but the most important and crucial systems code should be moved to massive parallel architectures.