3 ms·
bounded iirc, the activation functions need to be differentiable, but in practice they dont need to be strictly
by seydor 4y ago
bounded iirc, the activation functions need to be differentiable, but in practice they dont need to be strictly
- mejutoco 4y agoI thought gradient descent only worked on differentiable functions. https://en.wikipedia.org/wiki/Gradient_descent https://en.wikipedia.org/wiki/Gradient_descent