4 ms·
I think you can bridge the gap with a bit of discrete mathematics used to develop some forms of error correction. Worst case, quantum codes even.
by AstralStorm 9y ago
I think you can bridge the gap with a bit of discrete mathematics used to develop some forms of error correction. Worst case, quantum codes even.
- castle-bravo 9y agoCan you elaborate a bit? The connection between error correction codes and spiking neural networks isn't obvious to me.
- AstralStorm 9y agoA spiking neutral network can be considered a noisy real spiking channel transmitting contiguous real numbers. Similar on the surface to multibit sigma-delta modulation. There are many papers on this topic, e.g. https://papers.nips.cc/paper/4694-neuronal-spike-generation-mechanism-as-an-oversampling-noise-shaping-a-to-d-converter.pdf https://papers.nips.cc/paper/4694-neuronal-spike-generation-... Once you describe the specific modulation and noise properties you could recover the equivalent real valued continuous time neutral network from spiking neutral network. Then you can similarly map the training algorithms from gradient networks to "spike gradients". The next necessary step is to use (potentially quantum) interference in addition to integration or summation to train the interconnections. You will likely end up with quite complicated Hessians in both time and value.