3 ms·
Actually the feedback part of learning is important. There's a famous experiment with cats in baskets that demonstrated that. But AI isn't an animal so the sam
by IshKebab 2y ago
Actually the feedback part of learning is important. There's a famous experiment with cats in baskets that demonstrated that.
But AI isn't an animal so the same constraints don't necessarily apply. I think you'd have to have a particularly anti-AI & pedantic bent to complain about calling this language discovery.
- TeMPOraL 2y agoFeedback, yes. Feedback from interacting with the physical reality by means of physical body with flexible appendages? Useful in general, but neither necessary nor sufficient in case of learning language. Feedback is fundamental to deep neural networks, it's how they're trained. And to be honest, all of the things 'astromaniak mentions can be simulated and made part of training data set too. While the "full experience" may turn necessary for building AGI, the amount of success the field had with LLMs indicates that it's not necessary for the model to learn language (or even to learn all languages).