2 ms·
I see what you mean- thank you for the clarification. Well, I'm not really the right person to discuss this issue since I can't claim to understand how the bra
by YeGoblynQueenne 8y ago
I see what you mean- thank you for the clarification.
Well, I'm not really the right person to discuss this issue since I can't claim to understand how the brain works. However, I do understand a few things about connectionist methods and it's my understanding that they are not very good models of the way the brain works at all (am I misrepresenting your turn of phrase, of "biologically plausible"?). In that sense, I doubt it's possible that a neural net would develop symbolic reasoning by dint of being in some way similar to a biological brain.
In general, my experience with neural nets and gradient optimistation techniques is that unless a great deal of effort is spent directing their learning, they are prone to learn whatever is convenient, which is very often not what the human users want it to.
For instance, see the following collection of anecdotes of evolutionary algorithms lerning whatever they please, rather than what the researchers were trying to teach them:
https://arxiv.org/abs/1803.03453 https://arxiv.org/abs/1803.03453
Or the descriptions of the difficulties of training Deep Reinforcement Learning models in this article:
https://www.alexirpan.com/2018/02/14/rl-hard.html https://www.alexirpan.com/2018/02/14/rl-hard.html
Also, while I'm a staunch symbolicist myself, I'm not 100% convinced that symbolic reasoning is "natural". I think it rather took a lot of effort to develop such systems and most people still have a great deal of trouble using them with precision. If you meant to say that symbolic reasoning should arise spontaneously in a neural network, I see that as very unlikely.