Neural nets are one way to program which use the computation power available. It's a way to keep getting the benefits of Moore's law. The hardware is co-evolvi

Neural nets are one way to program which use the computation power available. It's a way to keep getting the benefits of Moore's law. The hardware is co-evolving with the software. GPUs with SIMD architecture, or TPU which are even more specialized will give a computational advantage to methods like neural nets which they have been designed for. The magic comes from the memory/computation power combo.