3 ms·
I find it helpful to think of developments in deep learning as being driven by three major frontiers...Firstly, there is the available computing power and infr
by AndrewKemendo 10y ago
I find it helpful to think of developments in deep learning as being driven by three major frontiers...Firstly, there is the available computing power and infrastructure,...secondly, there is the amount and quality of the training data and thirdly, the algorithms"
I'm really glad this was the approach taken and his examples really show why these are the important metrics with respect to DL. It's hard to underplay the dependencies between these three frontiers. Radical breakthroughs in algorithms make it easier to get better results on existing infrastructure. Better data on the same algorithms and infrastructure can transform results, and on and on.
- IanCal 10y agoI think there's been a big impact on having commonly used tools too. Tensorflow and the like have allowed people to share and easily build on each others work, including on shared models. Not unique to 2016, but I remember the struggles of trying to get hacked together matlab code working that it turned out was actually slightly different than must have been run for the paper. Now I'd expect a lot of work to come with a setup that anyone can easily get and try themselves.