Learning from sensory input and world interaction PLUS language is a huge thing. Like teaching a dog to sit. The dog learns about the world with all sorts of se

Learning from sensory input and world interaction PLUS language is a huge thing. Like teaching a dog to sit. The dog learns about the world with all sorts of sensory input, it interacts with the world, and it hears you speak a ton. But it'll never learn what "sit" means without an explicit combination of language and real world interaction. We do the same. Feedback loops are important too. Teaching your dog to sit, the words and actions you take depend on what the dog's doing. Teaching a baby to talk, your words and actions depend on what the kid's doing and saying, and maybe even asking and answering questions. Current language models learn language from how we use it, but only in relation to more language. Hopefully, we can eventually get some good data on how we use language in relation to the real world too. I can't imagine where you'd get a massive dataset like that though, shy of having robots out in the world acting like babies.