3 ms·

Oasis (the Minecraft world model) can serve about 5 players on 8 H100 in real-time at 20fps in 360p. This is a much more capable model with two orders of magnit

Oasis (the Minecraft world model) can serve about 5 players on 8 H100 in real-time at 20fps in 360p. This is a much more capable model with two orders of magnitude more context. They pretty much say it can't be played real-time, which I read as they generate less than 15fps@240p on 8 GPUs. Probably why they talk so much about using it for AI training and evaluation rather than human use. There is a distilled version that works in real-time, but they don't show anything from that version (which is a statement in itself). For reducing the price, ASICs like etched may be the way forwards [1]. The models will get bigger for a time, but there may be a lot of room for models that can exploit purpose-built hardware. 1: https://www.etched.com https://www.etched.com

onlyrealcuzzo 2y ago
> Probably why they talk so much about using it for AI training and evaluation rather than human use. What would they do / how would they use this output to make a better AI?
- bionhoward 2y ago
  Embodied cognition is a core theory for AGI; this would enable a vast array of bodies, environments, and situations, that high level of diversity can empower AI adaptability. For a straightforward example, this could help Waymo rehearse driving in various cities and weather / traffic settings
  - Rastonbury 2y ago
    Not meaning to pick at that example but a broader question the value of these, what use cases outside of games are they willing to let AI that is meant to interact with the real world be trained on AI synthetic data, that is like black box on black box, double the training and inference cost Even in games I expect a game playing model to exploit glitches present in world building one I think it's great that Google is researching these, but I can't see the return and if there is it is many steps away
    - nine_k 2y ago
      I bet the military is keenly interested.
latchkey 2y ago
Hey! I'd love to know how this performs on 8xMI300x in comparison. Reach out to me?

onlyrealcuzzo 2y ago

> Probably why they talk so much about using it for AI training and evaluation rather than human use. What would they do / how would they use this output to make a better AI?

bionhoward 2y ago
Embodied cognition is a core theory for AGI; this would enable a vast array of bodies, environments, and situations, that high level of diversity can empower AI adaptability. For a straightforward example, this could help Waymo rehearse driving in various cities and weather / traffic settings
- Rastonbury 2y ago
  Not meaning to pick at that example but a broader question the value of these, what use cases outside of games are they willing to let AI that is meant to interact with the real world be trained on AI synthetic data, that is like black box on black box, double the training and inference cost Even in games I expect a game playing model to exploit glitches present in world building one I think it's great that Google is researching these, but I can't see the return and if there is it is many steps away
  - nine_k 2y ago
    I bet the military is keenly interested.

latchkey 2y ago

Hey! I'd love to know how this performs on 8xMI300x in comparison. Reach out to me?