3 ms·
I used to use this a bunch when calculating gradient descent algorithms, but I've since moved to using libraries with auto-differentiation (numpy with autodiff
by highd 9y ago
I used to use this a bunch when calculating gradient descent algorithms, but I've since moved to using libraries with auto-differentiation (numpy with autodiff or theano) and it's a huge force multiplier for my work (not to mention GPU implementations basically for free).
Of course there's always some derivation that's easiest done by hand.
- netheril96 9y agoIsn't tensorflow the most popular auto differential library these days?
- gtani 9y agoProbably you could look at # Watches, Stars, forks etc to gauge that, but if you want to look at vs theano, torch, pyTorch, Caffe2, start with cs231N lecture: http://cs231n.stanford.edu/slides/2017/cs231n_2017_lecture8.pdf http://cs231n.stanford.edu/slides/2017/cs231n_2017_lecture8.... (I think there's vid on youtube)