5 ms·
I don't think any serious deep-learning researchers believe that their artificial models represent the reality of how an actual brain (or even the individual ne
by cr0sh 7y ago
I don't think any serious deep-learning researchers believe that their artificial models represent the reality of how an actual brain (or even the individual neurons) actually work.
That's an idea, I believe, that has been perpetuated in the general public's mind by popular science articles and descriptions about deep learning and neural networks, in a (largely successful) attempt to attract and gain attention for the subject and those articles.
One thing that did capture my imagination from this new research, though, as applied to deep learning, is whether this would necessarily cause any change in actual deep learning models?
That is, even if the dendrites are performing more complex computations, does that change anything about the "standard" layered model of deep learning systems, or does one simply add more artificial neurons to the model to compensate (and thus, nothing is really gained)?
Finally - and I know this is not the focus of this research - this new understanding doesn't seemingly do anything to advance our knowledge of how actual brains and neurons learn; as mentioned elsewhere, our current artificial models implement "back propagation" for learning purposes. While that has been a radically successful method, even its creator (Hinton) believes it to be wrong (and is working toward a different model of so-called "capsule networks" in response). As far as I am aware, no form of back propagation has been found to be performed in natural brains or neural networks, so we really don't know how this aspect works. Plenty of competing theories and ideas have sprung up regarding this.
Hopefully one day we'll figure it out; I'm of the opinion that, like so many other things that have been discovered in the past, when we do figure it out, it will probably be something extremely simple and curious as to how it remained overlooked for so long.
I kinda have a thought or idea that its done via "societal feedback loops" - that is, brains talking/interacting with other brains - though how you integrate this with a feedforward system isn't apparent to me. I'm also certain, though, that this idea isn't something new or unique (and it very likely is wrong, too).