2 ms·
True, though the timeline was more the other way around. Error backprop was used as a method for training before using AD to automate the implementation work be
by _0ffh 5d ago
True, though the timeline was more the other way around. Error backprop was used as a method for training before using AD to automate the implementation work became the norm. Previously you had to write the backward pass by hand, now we use AD to derive it from the forward pass.
- omnicognate 5d agoInteresting, didn't know that history. I've used algo diff but in unrelated fields. I think it's a technique that has been independently discovered several times and has terribly inconsistent terminology across domains as a result.