4 ms·
Out of genuine curiosity, what exactly is novel about this? Isn't back-propagation just the chain rule (i.e. as old as calculus). And I figure 'gradient descent
by stabbles 8y ago
Out of genuine curiosity, what exactly is novel about this? Isn't back-propagation just the chain rule (i.e. as old as calculus). And I figure 'gradient descent' was discovered not long after?
- georgeecollins 8y agoI am not an expert, but Marvin Minsky wrote a whole book about the kinds of problems that Neural Networks can't solve, that didn't take into account back-propagation. No one refuted it, as far as I know for a long time. This may all seem obvious now but I don't think anyone actually did it until the mid-eighties.