That's bullshit. All of the programs I have written recently had an incredible speedup after porting relevant parts of the program from single-threaded to GPU.

That's bullshit. All of the programs I have written recently had an incredible speedup after porting relevant parts of the program from single-threaded to GPU. Right now we are hitting the threshold of incompetent programmers and tools long before any other.