> Progress is slow. And incremental. Sometimes you'll hear people say that deep learning is nothing new, because the first deep neural networks were developed

> Progress is slow. And incremental. Sometimes you'll hear people say that deep learning is nothing new, because the first deep neural networks were developed many decades ago, or because CNNs and LSTMs were developed in the late 90s, etc. That mindset glosses over a lot of the incremental developments (e.g., getting a decent handle on transfer learning) that were necessary to get from the initial academic demonstration of the idea to its successful commercial application.