Isn’t the solution better “mechanical” and language integrations for “off-cpu compute”? CUDA and subsequent libs arguably provided this and caused a pretty mas

Isn’t the solution better “mechanical” and language integrations for “off-cpu compute”? CUDA and subsequent libs arguably provided this and caused a pretty massive acceleration in the amount of GPU-utilising code that got written. Now, CUDA might still be pretty awful to write, but if general-propose-GPU API’s continue to evolve and refine, we might be able to get to a point where something like an LLVM compiler can auto generate efficient GPU code for matrix ops, much like how it can auto-vectorise certain patterns now.