4 ms·
I assume that this only works for total derivatives (e.g., with respect to time) not general partial derivatives (i.e., the n-th total derivative with respect t
by choeger 7y ago
I assume that this only works for total derivatives (e.g., with respect to time) not general partial derivatives (i.e., the n-th total derivative with respect to another variable), right? Otherwise how would one avoid generating massive amounts of code, and temporary data along with it, if I want to
- nmca 7y agoYou can run a k steps of adam-sgd and differentiate through the learning rate and scalarising parameters of a composite loss function in order to meta-learn them. Support for general n-th total derivatives is rather good :)