4 ms·
BrainChip Provides Details of Neural Network Architecture
- tachyonbeam 11y agoI don't really understand why they chose to simulate spiking neurons. The deep learning community uses simpler models based on ReLUs and such, so it seems that BrainChip will be missing on that market, which is currently huge. Do we have training algorithms for spiking neurons? Is this aimed mostly at biological simulations?
- throwaway000002 11y agoI don't know anything about neural networks but the video in the article alludes to some advantage in terms of learning on the fly, which I'd appreciate if some expert could clarify. What I'm trying to say is that perhaps the flexibility of spiking neurons is that the training can be done "online", in the sense of an online algorithm, i.e. the data is processed as it arrives instead of existing entirely in memory beforehand. Perhaps traditional methods used by the deep learning community don't have good properties in this instance? Still, I believe there's a lot of future in "analog-esque" computation as we probe the frontiers of what's possible to fab and the cost of straight-jacketing the digital illusion onto tinier and tinier transistors.