4 ms·
Oh god, what he calls constraints are the "spiking nature of biological neurons", then he happily proceeds, just like you'd guess, to create this abomination of
by bra-ket 6y ago
Oh god, what he calls constraints are the "spiking
nature of biological neurons", then he happily proceeds, just like you'd guess, to create this abomination of 'spiking RNN' and train this pretty much plain vanilla RNN via backpropagation, completely disregarding the energy spent, learning mechanism, and actual biological plausibility or relevance of this horrendous architecture as memory model.
The first author knows just enough to be dangerous.
>Sejnowski fell asleep
it surely looks like it
- subroutine 6y agoDropping a link below in case you're interested - I have a side-project that takes a more literal approach to modeling biologically plausible neural networks (MCMC simulations inside 3D models)... https://github.com/bradmonk/plasticity https://github.com/bradmonk/plasticity