And yet they (GPUs) aren't (better for FLOP/watt than FPGA) everywhere. GPUs have very particular cache and computation hierarchy which is not necessarily a be

And yet they (GPUs) aren't (better for FLOP/watt than FPGA) everywhere. GPUs have very particular cache and computation hierarchy which is not necessarily a best/good fit for all problems that are being thrown at them.