Regarding his point 2 about cuda, I remember in the early days of computation on the gpu there were no such luxuries. People would formulate their problems as s

Regarding his point 2 about cuda, I remember in the early days of computation on the gpu there were no such luxuries. People would formulate their problems as say a pixel shader, and use a texture as input and read an image as output. Was called gpgpu. So cuda was basically a way of making an existing practice easier.