6 ms·
This [0] video has a quite interesting proposal to add AD to compilers. [0] https://youtu.be/1QQj1mAV-eY https://youtu.be/1QQj1mAV-eY
by secondcoming 5y ago
This [0] video has a quite interesting proposal to add AD to compilers.
[0] https://youtu.be/1QQj1mAV-eY https://youtu.be/1QQj1mAV-eY
- eigenspace 5y agoIMO automatic differentiation shouldn’t be baked into the compiler, because that forces a bit of a monoculture around one AD system and forces you to accept the trade offs of that particular AD system. The Julia approach has been instead to expose an interface for compiler plugins that any AD (or other ‘nonstandard interpretation / code transformation) library can access. There’s negative trade offs to to this as well, but I really like the way it’s turned out and I think it’s given us some fantastic tools for non-AD purposes as well.