3 ms·
As far as I understand it (which is not very far): Zygote calculates derivatives using source-to-source automatic differentiation. This calculates function in
by cbkeller 6y ago
As far as I understand it (which is not very far):
Zygote calculates derivatives using source-to-source automatic differentiation.
This calculates function inverses (so to stretch the analogy a bit, it's kinda like "source-to-source automatic inversion")
- ChrisRackauckas 6y agoNot necessarily: you can use it to build fast inverse of scalar functions. Here's an example on a vjp of an ODE f: https://gist.github.com/GiggleLiu/0c4608f70bda050f59992f5fc095e2cb https://gist.github.com/GiggleLiu/0c4608f70bda050f59992f5fc0...
- cbkeller 6y agoI'm probably just missing something, but did you mean to say "fast derivatives of scalar functions" by any chance? I.e., that you can use the free inverses to get at the derivatives in some way?
- ChrisRackauckas 6y agooh yes, I meant derivatives.