Okay, but that's a markedly different problem than the information density of the training data. It's: "can a rational machine trained only with natural languag

Okay, but that's a markedly different problem than the information density of the training data. It's: "can a rational machine trained only with natural language descriptions of the world form complex representations of it and solve associated problems described only in natural language?". For you and me, a verbal description of a pattern test such as "You are given seven squares. Square A contains a filled cross in the upper left position, an empty circle in the middle... etc." would send us grasping for pen and paper. But with training many people can play mental chess, there are famous blind theoretical physicists and so on. This all seems to suggest that natural language could be called "Turing complete", to bastardize the term, for describing the real world to a rational entity and formulating solutions to real world problems.