3 ms·
Thanks for sharing. I thought the discontinuous nature of the SNN made it non-differentiable and therefore unsuitable for SGD and backprop.
by openquery 2y ago
Thanks for sharing. I thought the discontinuous nature of the SNN made it non-differentiable and therefore unsuitable for SGD and backprop.
- Onavo 2y agoLol in differentiable programming they usually hard code an identity for the problematic parts (e.g. if statements)