4 ms·
Arbitrary functions that are differentiable, unless I am mistaken.
by mejutoco 4y ago
Arbitrary functions that are differentiable, unless I am mistaken.
- seydor 4y agobounded iirc, the activation functions need to be differentiable, but in practice they dont need to be strictly
- mejutoco 4y agoI thought gradient descent only worked on differentiable functions. https://en.wikipedia.org/wiki/Gradient_descent https://en.wikipedia.org/wiki/Gradient_descent