I think specifically Deep Learning is where all the magic is. The rest of machine learning (SVMs, clustering, decision trees, etc.) are all old methods that we

I think specifically Deep Learning is where all the magic is. The rest of machine learning (SVMs, clustering, decision trees, etc.) are all old methods that were invented in the 90's or earlier, recent lifts in data storage and compute power have made them proportionally more powerful but they haven't unlocked new technology as far as I know. Deep Learning wasn't even possible until recently though, data and compute power have made it possible as opposed to just proportionally better [1]. There have also been a lot of breakthroughs in Reinforcement Learning riding on the wave of Deep Learning, and both of those (DL and RL) are more than applied statistics. 1. I think of this as a 0 to 1 innovation versus a 1 to n innovation if you're familiar with Peter Thiel's terminology on that.