Isn't the whole point of CPUs is that you don't have to run code on GPUs and other special purpose processing units? You leave it to special circumstances when

Isn't the whole point of CPUs is that you don't have to run code on GPUs and other special purpose processing units? You leave it to special circumstances when you actually can't avoid doing it.