2 ms·

The way to make backpropagation work properly (for "Deep Learning") was only worked out a few years ago. However, this article dates it from the first idea. Pe

The way to make backpropagation work properly (for "Deep Learning") was only worked out a few years ago. However, this article dates it from the first idea. Perhaps similar to how relarional databases weren't practical until SQL and weren't workable until B-trees, but it's dated to Codd (which is fair).

p1esk 8y ago
Backpropagation has not changed since the 1986 paper.
- makapuf 8y ago
  The backpropagation principle itaeld is the same. But gradient computations and techniques to accelerate it or stabilize its convergence have progressed much