I dont mean to insult you but your last paragraph makes me not take you seriously at all. I could feel it in the rest of the post but the idea of an alien simul

I dont mean to insult you but your last paragraph makes me not take you seriously at all. I could feel it in the rest of the post but the idea of an alien simulation just reaks of ayuhasca fueled quack science > A lot of core concepts are the same or very similar. One point about core models is that LLMs mess up long contexts because they are trained on a static system rather (next token prediction) than a dynamic system (a reactive world, like a market or a road), so they dont know that their decisions affect the the world they are observing. This means they fundamentally cant model and extrapolate how actions affect current state. They can memorize and interpolate that as a static system, which is what they do for these videos and game systems, but that is incredibly data inefficient. Thats a core problem in them simulating games rather than understanding what a text says and means. The text wont change as they interpret it. These models will need to be re hypithesized to understand that their actions change their environment and that is not a trivial change thats a few years ago, thats a change at the level of the transformers where it might happen next year or 50 years from now. theres no way to tell