10 ms·

Consistency over multiple minutes and it runs in real time at 720p? I did not expect world models to be this good yet. > Genie 3’s consistency is an emergent c

Consistency over multiple minutes and it runs in real time at 720p? I did not expect world models to be this good yet. > Genie 3’s consistency is an emergent capability So this just happened from scaling the model, rather than being a consequence of deliberate architecture changes? Edit: here is some commentary on limitations from someone who tried it: https://x.com/tejasdkulkarni/status/1952737669894574264 https://x.com/tejasdkulkarni/status/1952737669894574264 > - Physics is still hard and there are obvious failure cases when I tried the classical intuitive physics experiments from psychology (tower of blocks). > - Social and multi-agent interactions are tricky to handle. 1vs1 combat games do not work > - Long instruction following and simple combinatorial game logic fails (e.g. collect some points / keys etc, go to the door, unlock and so on) > - Action space is limited > - It is far from being a real game engines and has a long way to go but this is a clear glimpse into the future. Even with these limitations, this is still bonkers. It suggests to me that world models may have a bigger part to play in robotics and real world AI than I realized. Future robots may learn in their dreams...

kfarr 1y ago
Bitter lesson strikes again!
- nxobject 1y ago
  _Especially_ given the goal of a world model using a rasters-only frame-by-frame approach. Holy shit.
  - kranke155 1y ago
    It is truly remarkable. Even if you expected this to happen eventually, like I did, it seems like your assumptions are 2-10x of the time it’s needed to progress. It makes me think that Stargate might actually lead to AGI/ASI
ivape 1y ago
So this just happened from scaling the model Unbelievable. How is this not a miracle? So we're just stumbling onto breakthroughs?
- silveraxe93 1y ago
  Is it actually unbelievable? It's basically what every major AI lab head is saying from the start. It's the peanut gallery that keeps saying they are lying to get funding.
  - ivape 1y ago
    It's akin to us sending a rocket to space and immediately discovering a wormhole. Sure, there's a lot of science about what's out there, but to discover all this in our first few trips to orbit ...
    - silveraxe93 1y ago
      Lemme start by saying this is objectively amazing. But I just really wouldn't call it a breakthrough. We had one breakthrough a couple of years ago with GPT-3, where we found that neural networks / transformers + scale does wonders. Everything else has been a smooth continuous improvement. Compare today's announcement to Genie-2[1] release less than 1 year ago. The speed is insane, but not surprising if you put in context on how fast AI is advancing. Again, nothing _new_. Just absurdly fast continuous progress. [1] - https://deepmind.google/discover/blog/genie-2-a-large-scale-foundation-world-model/ https://deepmind.google/discover/blog/genie-2-a-large-scale-...
      - ducktective 1y ago
        Wasn't the model winning gold in IMO result of a breakthrough? I doubt an stochastic parrot can solve math at IMO level...
        Philpax 1y ago
diwank 1y ago
> Future robots may learn in their dreams... So prescient. I definitely think this will be a thing in the near future ~12-18 months time horizon
- deleted 1y ago
  [deleted]
- neom 1y ago
  I'm invested in a startup that is doing something unrelated robotics, but they're spending a lot of time in Shenzhen, I keep a very close eye on robotics and was talking to their CTO about what he is seeing in China, versions of this are already being implemented.
  - dingnuts 1y ago
    [flagged]
    - sureglymop 1y ago
      I have no doubts that is the case. Just look at this new Unitree robot that was unveiled a mere 6 hours ago: https://youtu.be/ve9USu7zpLU?feature=shared https://youtu.be/ve9USu7zpLU?feature=shared And these are consumer options, affordable to you and me, not only to some military. If those are the commonly available options... there may be way more advanced stuff that we haven't seen.
      - dingnuts 1y ago
        this stuff is old tech, and has nothing to do with transformers. The Boston Dynamics style robot dogs are always shown in marketing demos like the one you linked in secretly very controlled environments. Let me know when I can order one that will bring the laundry downstairs for my wife. I asked for real examples from someone who claimed to have first hand experience, not more marketing bullshit
    - schmidtleonard 1y ago
casenmgreen 1y ago
The guy who tried was invite by Google to try it. He seems to me too enthusiastic, such that I feel Google asked him in particular because they trusted him to write very positively.
- alphabetting 1y ago
  I doubt there was a condition on writing positively. Other people who tested have said this won't replace engines. https://togelius.blogspot.com/2025/08/genie-3-and-future-of-neural-game.html https://togelius.blogspot.com/2025/08/genie-3-and-future-of-...
  - echelon 1y ago
    > What I don't think this technology will do is replace game engines. I just don't see how you could get the very precise and predictable editing you have in a regular game engine from anything like the current model. The real advantage of game engines is how they allow teams of game developers to work together, making small and localized changes to a game project. I've been thinking about this a while and it's obvious to me: Put Minecraft (or something similar) under the hood. You just need data structures to encode the world. To enable mutation, location, and persistence. If the model is given additional parameters such as a "world mesh", then it can easily persist where things are, what color or texture they should be, etc. That data structure or server can be running independently on CPU-bound processes. Genie or whatever "world model" you have is just your renderer. It probably won't happen like this due to monopolistic forces, but a nice future might be a future where you could hot swap renderers between providers yet still be playing the same game as your friends - just with different looks and feels. Experiencing the world differently all at the same time. (It'll probably be winner take all, sadly, or several independent vertical silos.) If I were Tim Sweeny at Epic Games, I'd immediately drop all work on Unreal Engine and start looking into this tech. Because this is going to shore them up on both the gaming and film fronts.
    - K0balt 1y ago
      As a renderer, given a POV, lighting conditions, and world mesh might be a very, very good system. Sort of a tight MCP connection to the world-state. I think in this context, it could be amazing for game creation. I’d imagine you would provide item descriptions to vibe-code objects and behavior scripts, set up some initial world state(maps), populated with objects made of objects - hierarchically vibe-modeled, make a few renderings to give inspirational world-feel and textures, and vibe-tune the world until you had the look and feel you want. Then once the textures and models and world were finalised, it would be used as the rendering context. I think this is a place that there is enough feedback loops and supervision that with decent tools along these lines, you could 100x the efficiency of game development. It would blow up the game industry, but also spawn a million independent one or two person studios producing some really imaginative niche experiences that could be much, much more expansive (like a AAA title) than the typical indie-studio product.
kkukshtel 1y ago
I similarly am surprised at how fast they are progressing. I wrote this piece a few months ago about how I think steering world model output is the next realm of AAA gaming: https://kylekukshtel.com/diffusion-aaa-gamedev-doom-minecraft https://kylekukshtel.com/diffusion-aaa-gamedev-doom-minecraf... But even when I wrote that I thought things were still a few years out. I facetiously said that Rockstar would be nerd-sniped on GTA6 by a world model, which sounded crazy a few months ago. But seeing the progress already made since GameNGen and knowing GTA6 is still a year away... maybe it will actually happen.
- throwmeaway222 1y ago
  I'm trying to wrap my head around this since we're still seeing text spit out slowly ( I mean slowly as in 1000's of tokens a second) I'm starting to think some of the names behind LLMs/GenAI are cover names for aliens and any actual humans involved have signed an NDA that comes with millions of dollars and a death warrant if disobeyed.
  - dr_dshiv 1y ago
    Lizard people?
- ewoodrich 1y ago
  > Rockstar would be nerd-sniped on GTA6 by a world model I'm having trouble parsing your meaning here. GTA isn't really a "drive on the street simulator", is it? There is deliberate creative and artistic vision that makes the series so enjoyable to play even decades after release, despite the graphics quality becoming more dated every year by AAA standards. Are you saying someone would "vibe model" a GTAish clone with modern graphics that would overtake the actual GTA6 in popularity? That seems extremely unlikely to me.
  - everforward 1y ago
    Probably depends on how you engage with GTA. “Drive on the street simulator” along with arrays of weapons and explosions is the majority of my hours in GTA. I despise the creative and artistic vision of GTA online, but I’m clearly in a minority there gauging by how much money they’ve made off it.
forrestthewoods 1y ago
> this is a clear glimpse into the future. Not for video games it isn’t.
- dlivingston 1y ago
  Unless and until state can be stored outside of the model. I for one would love a video game where you're playing in a psychedelic, dream-like fugue.
  - throwmeaway222 1y ago
    It's kinda crazy though that a single game session would be burning enough natural gas to power 3 cities. Unless that's not true
  - forrestthewoods 1y ago
    It is plausible to run a full simulation the old fashioned way and realtime render it with a diffusion model. It is not currently, or near term, realistic to make a video game where a meaningful portion of the simulation is part of the model. There will probably be a few interactive model-first experiences. But they’ll be popular as short novelties not meaningful or long experiences. A simple question to consider is how would you adjust a set of simple tunables in a model-first simulator? For example giving the player more health, making enemies deal 2x damage, increasing move speed, etc etc. You can not.
  - chrz 1y ago
    Unless you can change fundamental problem that it doesnt follow the state the way you want exactly
tugn8r 1y ago
But that was always going to be the case? Reality is not composed of words, syntax, and semantics. A human modal is. Other human modals are sensory only, no language. So vision learning and energy models that capture the energy to achieve a visual, audio, physical robotics behavior are the only real goal. Software is for those who read the manual with their new NES game. Where are the words inside us? Statistical physics of energy to make machine draw the glyphs of language not opionated clustering of language that will close the keyboard and mouse input loop. We're like replicating human work habits. Those are real physical behaviors. Not just descriptions in words.
ojosilva 1y ago
Gaming is certainly a use case, but I think this is primarily coming as synthetic data generation for Google's robots training in warehouses: https://www.theguardian.com/technology/2025/aug/05/google-step-artificial-general-intelligence-deepmind-agi https://www.theguardian.com/technology/2025/aug/05/google-st... Gemini Robot launch 4 mo ago: https://news.ycombinator.com/item?id=43344082 https://news.ycombinator.com/item?id=43344082
- onlyrealcuzzo 1y ago
  This also seems pretty valuable to create CGI cut scenes...
resters 1y ago
consider the hardware DOOM runs on. 720p would only be a true test of capability if every bit of possible detail was used.
SequoiaHope 1y ago
Yeah this is going to be excellent for robotics because it’s good enough to clear the reality gap (visually - physics would be another story).
ProofHouse 1y ago
Curious how multiplayer would possibly work not only logistically, but technically and from a game play POV
eboynyc32 1y ago
Wow. How do we know if we’re not in Genie 4 right now.

kfarr 1y ago

Bitter lesson strikes again!

nxobject 1y ago
_Especially_ given the goal of a world model using a rasters-only frame-by-frame approach. Holy shit.
- kranke155 1y ago
  It is truly remarkable. Even if you expected this to happen eventually, like I did, it seems like your assumptions are 2-10x of the time it’s needed to progress. It makes me think that Stargate might actually lead to AGI/ASI

ivape 1y ago

So this just happened from scaling the model Unbelievable. How is this not a miracle? So we're just stumbling onto breakthroughs?

silveraxe93 1y ago
Is it actually unbelievable? It's basically what every major AI lab head is saying from the start. It's the peanut gallery that keeps saying they are lying to get funding.
- ivape 1y ago
  It's akin to us sending a rocket to space and immediately discovering a wormhole. Sure, there's a lot of science about what's out there, but to discover all this in our first few trips to orbit ...
  - silveraxe93 1y ago
    Lemme start by saying this is objectively amazing. But I just really wouldn't call it a breakthrough. We had one breakthrough a couple of years ago with GPT-3, where we found that neural networks / transformers + scale does wonders. Everything else has been a smooth continuous improvement. Compare today's announcement to Genie-2[1] release less than 1 year ago. The speed is insane, but not surprising if you put in context on how fast AI is advancing. Again, nothing _new_. Just absurdly fast continuous progress. [1] - https://deepmind.google/discover/blog/genie-2-a-large-scale-foundation-world-model/ https://deepmind.google/discover/blog/genie-2-a-large-scale-...
    - ducktective 1y ago
      Wasn't the model winning gold in IMO result of a breakthrough? I doubt an stochastic parrot can solve math at IMO level...
      - Philpax 1y ago

diwank 1y ago

> Future robots may learn in their dreams... So prescient. I definitely think this will be a thing in the near future ~12-18 months time horizon

deleted 1y ago
[deleted]
neom 1y ago
I'm invested in a startup that is doing something unrelated robotics, but they're spending a lot of time in Shenzhen, I keep a very close eye on robotics and was talking to their CTO about what he is seeing in China, versions of this are already being implemented.
- dingnuts 1y ago
  [flagged]
  - sureglymop 1y ago
    I have no doubts that is the case. Just look at this new Unitree robot that was unveiled a mere 6 hours ago: https://youtu.be/ve9USu7zpLU?feature=shared https://youtu.be/ve9USu7zpLU?feature=shared And these are consumer options, affordable to you and me, not only to some military. If those are the commonly available options... there may be way more advanced stuff that we haven't seen.
    - dingnuts 1y ago
      this stuff is old tech, and has nothing to do with transformers. The Boston Dynamics style robot dogs are always shown in marketing demos like the one you linked in secretly very controlled environments. Let me know when I can order one that will bring the laundry downstairs for my wife. I asked for real examples from someone who claimed to have first hand experience, not more marketing bullshit
  - schmidtleonard 1y ago

casenmgreen 1y ago

The guy who tried was invite by Google to try it. He seems to me too enthusiastic, such that I feel Google asked him in particular because they trusted him to write very positively.

alphabetting 1y ago
I doubt there was a condition on writing positively. Other people who tested have said this won't replace engines. https://togelius.blogspot.com/2025/08/genie-3-and-future-of-neural-game.html https://togelius.blogspot.com/2025/08/genie-3-and-future-of-...
- echelon 1y ago
  > What I don't think this technology will do is replace game engines. I just don't see how you could get the very precise and predictable editing you have in a regular game engine from anything like the current model. The real advantage of game engines is how they allow teams of game developers to work together, making small and localized changes to a game project. I've been thinking about this a while and it's obvious to me: Put Minecraft (or something similar) under the hood. You just need data structures to encode the world. To enable mutation, location, and persistence. If the model is given additional parameters such as a "world mesh", then it can easily persist where things are, what color or texture they should be, etc. That data structure or server can be running independently on CPU-bound processes. Genie or whatever "world model" you have is just your renderer. It probably won't happen like this due to monopolistic forces, but a nice future might be a future where you could hot swap renderers between providers yet still be playing the same game as your friends - just with different looks and feels. Experiencing the world differently all at the same time. (It'll probably be winner take all, sadly, or several independent vertical silos.) If I were Tim Sweeny at Epic Games, I'd immediately drop all work on Unreal Engine and start looking into this tech. Because this is going to shore them up on both the gaming and film fronts.
  - K0balt 1y ago
    As a renderer, given a POV, lighting conditions, and world mesh might be a very, very good system. Sort of a tight MCP connection to the world-state. I think in this context, it could be amazing for game creation. I’d imagine you would provide item descriptions to vibe-code objects and behavior scripts, set up some initial world state(maps), populated with objects made of objects - hierarchically vibe-modeled, make a few renderings to give inspirational world-feel and textures, and vibe-tune the world until you had the look and feel you want. Then once the textures and models and world were finalised, it would be used as the rendering context. I think this is a place that there is enough feedback loops and supervision that with decent tools along these lines, you could 100x the efficiency of game development. It would blow up the game industry, but also spawn a million independent one or two person studios producing some really imaginative niche experiences that could be much, much more expansive (like a AAA title) than the typical indie-studio product.

kkukshtel 1y ago

I similarly am surprised at how fast they are progressing. I wrote this piece a few months ago about how I think steering world model output is the next realm of AAA gaming: https://kylekukshtel.com/diffusion-aaa-gamedev-doom-minecraft https://kylekukshtel.com/diffusion-aaa-gamedev-doom-minecraf... But even when I wrote that I thought things were still a few years out. I facetiously said that Rockstar would be nerd-sniped on GTA6 by a world model, which sounded crazy a few months ago. But seeing the progress already made since GameNGen and knowing GTA6 is still a year away... maybe it will actually happen.

throwmeaway222 1y ago
I'm trying to wrap my head around this since we're still seeing text spit out slowly ( I mean slowly as in 1000's of tokens a second) I'm starting to think some of the names behind LLMs/GenAI are cover names for aliens and any actual humans involved have signed an NDA that comes with millions of dollars and a death warrant if disobeyed.
- dr_dshiv 1y ago
  Lizard people?
ewoodrich 1y ago
> Rockstar would be nerd-sniped on GTA6 by a world model I'm having trouble parsing your meaning here. GTA isn't really a "drive on the street simulator", is it? There is deliberate creative and artistic vision that makes the series so enjoyable to play even decades after release, despite the graphics quality becoming more dated every year by AAA standards. Are you saying someone would "vibe model" a GTAish clone with modern graphics that would overtake the actual GTA6 in popularity? That seems extremely unlikely to me.
- everforward 1y ago
  Probably depends on how you engage with GTA. “Drive on the street simulator” along with arrays of weapons and explosions is the majority of my hours in GTA. I despise the creative and artistic vision of GTA online, but I’m clearly in a minority there gauging by how much money they’ve made off it.

forrestthewoods 1y ago

> this is a clear glimpse into the future. Not for video games it isn’t.

dlivingston 1y ago
Unless and until state can be stored outside of the model. I for one would love a video game where you're playing in a psychedelic, dream-like fugue.
- throwmeaway222 1y ago
  It's kinda crazy though that a single game session would be burning enough natural gas to power 3 cities. Unless that's not true
- forrestthewoods 1y ago
  It is plausible to run a full simulation the old fashioned way and realtime render it with a diffusion model. It is not currently, or near term, realistic to make a video game where a meaningful portion of the simulation is part of the model. There will probably be a few interactive model-first experiences. But they’ll be popular as short novelties not meaningful or long experiences. A simple question to consider is how would you adjust a set of simple tunables in a model-first simulator? For example giving the player more health, making enemies deal 2x damage, increasing move speed, etc etc. You can not.
- chrz 1y ago
  Unless you can change fundamental problem that it doesnt follow the state the way you want exactly

tugn8r 1y ago

But that was always going to be the case? Reality is not composed of words, syntax, and semantics. A human modal is. Other human modals are sensory only, no language. So vision learning and energy models that capture the energy to achieve a visual, audio, physical robotics behavior are the only real goal. Software is for those who read the manual with their new NES game. Where are the words inside us? Statistical physics of energy to make machine draw the glyphs of language not opionated clustering of language that will close the keyboard and mouse input loop. We're like replicating human work habits. Those are real physical behaviors. Not just descriptions in words.

ojosilva 1y ago

Gaming is certainly a use case, but I think this is primarily coming as synthetic data generation for Google's robots training in warehouses: https://www.theguardian.com/technology/2025/aug/05/google-step-artificial-general-intelligence-deepmind-agi https://www.theguardian.com/technology/2025/aug/05/google-st... Gemini Robot launch 4 mo ago: https://news.ycombinator.com/item?id=43344082 https://news.ycombinator.com/item?id=43344082

onlyrealcuzzo 1y ago
This also seems pretty valuable to create CGI cut scenes...

resters 1y ago

consider the hardware DOOM runs on. 720p would only be a true test of capability if every bit of possible detail was used.

SequoiaHope 1y ago

Yeah this is going to be excellent for robotics because it’s good enough to clear the reality gap (visually - physics would be another story).

ProofHouse 1y ago

Curious how multiplayer would possibly work not only logistically, but technically and from a game play POV

eboynyc32 1y ago

Wow. How do we know if we’re not in Genie 4 right now.