3 ms·
Can you elaborate a bit? The connection between error correction codes and spiking neural networks isn't obvious to me.
by castle-bravo 9y ago
Can you elaborate a bit? The connection between error correction codes and spiking neural networks isn't obvious to me.
- AstralStorm 9y agoA spiking neutral network can be considered a noisy real spiking channel transmitting contiguous real numbers. Similar on the surface to multibit sigma-delta modulation. There are many papers on this topic, e.g. https://papers.nips.cc/paper/4694-neuronal-spike-generation-mechanism-as-an-oversampling-noise-shaping-a-to-d-converter.pdf https://papers.nips.cc/paper/4694-neuronal-spike-generation-... Once you describe the specific modulation and noise properties you could recover the equivalent real valued continuous time neutral network from spiking neutral network. Then you can similarly map the training algorithms from gradient networks to "spike gradients". The next necessary step is to use (potentially quantum) interference in addition to integration or summation to train the interconnections. You will likely end up with quite complicated Hessians in both time and value.