Humans don't just generate language out of the void. The use of language is grounded by various other inputs (senses, previous knowledge/understanding). So wh

Humans don't just generate language out of the void. The use of language is grounded by various other inputs (senses, previous knowledge/understanding). So when a human is constructing sentences those sentences aren't just using earlier elements of the conversation to generate the next sentence (as language models do) but rather a vast wealth of resources previously accumulated. AI that wants to actually generate language with human-like intelligence needs more inputs than just language to its model. Sure that information can also be overfit, but the lack of other inputs goes beyond just the computer model overfitting it's data.