GPUs aren't good for everything. The right thing to do is balance between CPU and GPU code, and only do what actually gives any benefit. For example, GPUs suck

GPUs aren't good for everything. The right thing to do is balance between CPU and GPU code, and only do what actually gives any benefit. For example, GPUs suck at working on texts, or when there is a lot of divergence between processes. For example, if you have several kernels that branch to the TRUE side of the IF condition, and several that branch to FALSE, you're paying a huge performance penalty.