But it is. By training on language it is forming structures within itself that are isomorphic to the structures that exist in the world, through the relationshi

But it is. By training on language it is forming structures within itself that are isomorphic to the structures that exist in the world, through the relationships between words. These models are the same models that we have in our heads. There are vast interlocking webs of relationships that define how we think about the world - these are encoded within the language we use, the models can pick out these structures and replicate them. It is no surprise at al that they are as capable as they are. What you are seeing is a baby intelligence that is getting things wrong through lack of experience and lack of different information modalities. It's trained only on words for God's sake! You are looking at a baby savant and deluding yourself into thinking there is no intelligence there. You are all in for a shock.