> A world model is not a requirement for next token prediction in general. Conjecture. Maybe they all have world models, they're just worse world models. There

> A world model is not a requirement for next token prediction in general. Conjecture. Maybe they all have world models, they're just worse world models. There is no threshold beyond which something is or is not a world model, there is a continuum of models of varying degrees of accuracy. No human has ever had a perfectly accurate world model either. > One white paper with data that _suggests_ the author’s hypothesis is far from proof. This is far from the only paper. > This is a tired stochastic parrot argument that I don’t feel like engaging again, sorry. Much like your tired stochastic parrot argument about LLMs.