3 ms·

I submitted this because of the Hinton thread...

• carapace 9y ago
  When people bring up Hinton, I'm always like, "Yeah, Hinton is great, but have you tried Schmidhuber?" ;-) http://people.idsia.ch/~juergen/ http://people.idsia.ch/~juergen/ Cf. "Deep Learning in Neural Networks: An Overview" http://people.idsia.ch/~juergen/deep-learning-overview.html http://people.idsia.ch/~juergen/deep-learning-overview.html > Abstract. In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarises relevant work, much of it from the previous millennium. Shallow and deep learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. I review deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.
  • danstanflan 9y ago
    This guy is great. I love his theory of art and science, especially where he relates scientific discovery to data compression.