AI processor speedups will advance faster than Moore's law in the next 2-3 years, mostly due to lower precision (12/8/4 bits instead of 64/32 bits), massive par

AI processor speedups will advance faster than Moore's law in the next 2-3 years, mostly due to lower precision (12/8/4 bits instead of 64/32 bits), massive parallelism, and a different programming paradigm. Google's TPU's for example are close to hardwired matrix multiplication. Maybe speedups for traditional scalar-oriented code matters less now. Intel Lake Crest: "will enable training of neural networks at 100 times the performance on today’s GPUs, said Diane Bryant, executive vice president and general manager of Intel’s data center group" https://venturebeat.com/2016/11/17/intel-will-test-nervanas-lake-crest-silicon-in-first-half-of-2017-knights-crest-also-coming/ https://venturebeat.com/2016/11/17/intel-will-test-nervanas-... Google TPU: "The TPU...used 8-bit integer math...process 92 TOPS" (trillion operations per second) https://www.nextplatform.com/2017/04/05/first-depth-look-googles-tpu-architecture/ https://www.nextplatform.com/2017/04/05/first-depth-look-goo... Generally: http://www.moorinsightsstrategy.com/what-to-expect-in-2017-from-amd-intel-nvidia-xilinx-and-others-for-machine-learning/ http://www.moorinsightsstrategy.com/what-to-expect-in-2017-f...