A charitable interpretation of what you're saying is that humans produce lots of original data from their experiences of the world, like thinking about their ex

A charitable interpretation of what you're saying is that humans produce lots of original data from their experiences of the world, like thinking about their experiences, imagining what they would have done differently, and perhaps even dreaming. I agree with the root comment that something is fundamentally missing, and probably it is the ability to iteratively learn from one's own experiences, test understanding, and recursively improve. There are definitely teams working on applying reinforcement learning to LLMs. Maybe that will unlock new potential from finite training data.