Ya, I don't know about their approximation, but I think we've already found ourselves hitting some limits with computing power and data on big NLP ML models. Th

Ya, I don't know about their approximation, but I think we've already found ourselves hitting some limits with computing power and data on big NLP ML models. The appearance of custom chips is a pretty good example. Maybe for text we won't run out of data, considering the internet has so much text available. But I still think that the "human learning" is something to consider. Maybe a baby is a statistical machine, and it has a statistical based model that's so good it needs very little data, but it's also possible it uses something more logic based. In any case, I feel at least a baby would combine multiple learnings together, it would have started to learn about the dimensions and shapes and temperatures and properties of various physical objects, while simultaneously learning about the language used to refer to those things. I think this last piece can allow a baby to connect the predictions of real things with the language used, which then helps provide semantics for the language that are taken into consideration by a human.