32 ms·
Do you mean Flux? I've had to define my own gradients in Flux before, but that was two years ago, maybe things have improved?
by Buttons840 4y ago
Do you mean Flux?
I've had to define my own gradients in Flux before, but that was two years ago, maybe things have improved?
- constantcrying 4y agoIIRC even two years ago you could get gradients by AD in Flux (you are completely correct about the name). Nowadays you have https://fluxml.ai/Flux.jl/stable/training/zygote https://fluxml.ai/Flux.jl/stable/training/zygote to calculate gradients with AD. In any case AD in general is useful for NNs if you want to implement a novel layer. Of course you could instead derive back propagation by algebraic or manual differentiation instead.
- Buttons840 4y agoIt was only one weird operation I was doing that needed a gradient defined. I should have made that more clear. I was using Zygote.