3 ms·
we don't necessarily need to believe the hype. Neuroscience has not discovered something that can be used reliably in connectionist networks recently. The prev
by buboard 8y ago
we don't necessarily need to believe the hype. Neuroscience has not discovered something that can be used reliably in connectionist networks recently. The prevailing model for learning/plasticity (hebbian - "fire together wire together") is an obviously dumb model, and plasticity has proved hard to crack. A lot of people do not believe that the artifacts observed under STDP experiments are fundamental[1]. So the key question that has to be answered before neuroscience can influence deep learning is how plasticity works. With that in mind, all the neuromorphic computing platforms that have been proposed so far seem premature optimizations.
1. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3059684/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3059684/