3 ms·

This isn't what I expected when I heard "world model"!

• surreal_ 29d ago
  ik, "world model" has too many definitions at this point. imo the bar is just: can it simulate the world.
  • benatkin 29d ago
    Not really. Whether you agree with LeCun's assertion that "LLMs Are a Dead End" or not, world modeling is the same domain. "World Modeling" in this post is confusing because it seems to reference the deep, specific machine learning that goes into these frontier world models and self-driving cars, where it's really just vibe coding turned at the problem of modeling the sort of 3D worlds you'd find in a video game.
• hliyan 28d ago
  Agreed. Author should not be using this term. A world model, as I understand, is what an LLM is missing that a human brain has: in addition to a linguistically described world, we also posses a sensory model of the world, a physics model so to speak, against which the random token/thought chains generated by our brains can be validated.
  • deleted 28d ago
    [deleted]
  • Reebz 25d ago
    being reductive, causality is the key term for a world model. the rollout is the key action to demonstrate causality. lots of nice LLMs can generate a 3d representation of a "visual world". These days the focus is on sensory data (image, video, etc.), however world models can be more than just 3d spatial representations - they could be tabular. Again being reductive, its how do you predict the next state from the current state (the rollout).