GPUs are a bit silly, even though they work well, since the power consumption per unit of computation is higher than FPGAs , and orders of magnitude higher than

GPUs are a bit silly, even though they work well, since the power consumption per unit of computation is higher than FPGAs , and orders of magnitude higher than the human brain. The problem with deep learning is that real brains don't do multiply-accumulates and so contain no power-sucking floating point hardware. So there is a lot of room for improvement here.