> With the exception of a few modern breakthroughs like GAN And ReLU (2011). And Glorot initialzation (2010). And He initialization (2015). And Dropout (2014).

> With the exception of a few modern breakthroughs like GAN And ReLU (2011). And Glorot initialzation (2010). And He initialization (2015). And Dropout (2014). And Batch Normalization (2015). And Adam optimizer (2014). And distillation (2015). And... None of these were known or used in 70s and 80s and performance difference is enormous.