Or as Urs Hoezel would say: "advancing Moore's Law by 7 years(tm)..." Badum ba bum bum... And given Frank Seide et al. demonstrated 1-bit SGD in 2014 (https:/

Or as Urs Hoezel would say: "advancing Moore's Law by 7 years(tm)..." Badum ba bum bum... And given Frank Seide et al. demonstrated 1-bit SGD in 2014 (https://www.microsoft.com/en-us/research/publication/1-bit-stochastic-gradient-descent-and-application-to-data-parallel-distributed-training-of-speech-dnns/ https://www.microsoft.com/en-us/research/publication/1-bit-s...) the race to the bottom is just beginning...