3 ms·
The Julia ecosystem provides has a library that includes the differentiation rules hinted at at the end. https://github.com/JuliaDiff/ChainRules.jl https://git
by freemint 6y ago
The Julia ecosystem provides has a library that includes the differentiation rules hinted at at the end.
https://github.com/JuliaDiff/ChainRules.jl https://github.com/JuliaDiff/ChainRules.jl is used by (almost all) automatic differentiation engines and provides an extensive list of such rules.
If the example used sin|cos the auto diff implementations in Julia would have called native cos|-sin and not encurred such a "truncation error". However the post illustrates the idea in a good way.
Good post oxinabox
- oxinabox 6y ago> https://github.com/JuliaDiff/ChainRules.jl https://github.com/JuliaDiff/ChainRules.jl is used by (almost all) automatic differentiation engines and provides an extensive list of such rules. ChainRules is going to be used by everything. Right now it is used by 3 AD and a PR is open for a 4th, plus one thing that hasn't been released yet. For context of anyone who doesn't know, I am the lead maintainer of ChainRules.jl, (and the auther of this blog post)