4 ms·
Oh! Can you give some pointers where to read about it more?
by ggr2342 3y ago
Oh! Can you give some pointers where to read about it more?
- PartiallyTyped 3y agoThe original 2017 PyTorch paper is probably a good one.
- 6gvONxR4sf7o 3y agoThe wikipedia page for automatic differentiation and its references would be a good start. https://en.wikipedia.org/wiki/Automatic_differentiation https://en.wikipedia.org/wiki/Automatic_differentiation In particular, the section "Beyond forward and reverse accumulation" tells you how hard it is to deal with the graph in optimal ways, hence the popularity of simpler forwards and backwards traversals of the graph.