3 ms·

Deep learning (multilayer perceptrons) was 1965... The timeline is pretty long.

• kleiba 4y ago
  Maybe on a theoretical level, but of course you will agree that what we mean by deep learning today has only become possible with the availability of sufficient computational power (and Hinton's work around the mid-2000's).
  • fulafel 4y ago
    There are lots of important moments I guess, I would credit the main break in practicality to the ~1990 Swiss/German stuff: https://people.idsia.ch/~juergen/deep-learning-miraculous-year-1990-1991.html#Sec.%201 https://people.idsia.ch/~juergen/deep-learning-miraculous-ye... But still even the early perceptrons stuff was applied research, I wouldn't call it purely theoretical by any means.
    • kleiba 4y ago
      I agree about your notion of there being lots of important moments in history, and Schmidhuber's contributions are not small by any means. Yet, 1990 was not the year when Deep Learning took off.