3 ms·
IIRC even two years ago you could get gradients by AD in Flux (you are completely correct about the name). Nowadays you have https://fluxml.ai/Flux.jl/stable/tr
by constantcrying 4y ago
IIRC even two years ago you could get gradients by AD in Flux (you are completely correct about the name).
Nowadays you have https://fluxml.ai/Flux.jl/stable/training/zygote https://fluxml.ai/Flux.jl/stable/training/zygote to calculate gradients with AD.
In any case AD in general is useful for NNs if you want to implement a novel layer. Of course you could instead derive back propagation by algebraic or manual differentiation instead.
- Buttons840 4y agoIt was only one weird operation I was doing that needed a gradient defined. I should have made that more clear. I was using Zygote.