3 ms·
Any ideas if it keeps continuity - when you turn around, is the invented chair still there, or does everything shift like in a dream?
by exe34 1mo ago
Any ideas if it keeps continuity - when you turn around, is the invented chair still there, or does everything shift like in a dream?
- dmarcos 1mo agoI believe so. This is not a model that generates pixels frame by frame from user input like genie 3. Instead, there’s an actual 3D scene / structure generated (point cloud, 3dgs) from the input images.
- deleted 1mo ago[deleted]
- xyzsparetimexyz 1mo agoWrong, it does go straight to generating images.
- dmarcos 1mo agoFrom blog post: “It generates both image frames from novel views and explicit 3D outputs” Model can indeed generate novel views but I don’t think in real time (I could be wrong). If you want to navigate a space in real time as user above was asking gotta rely on the 3D output and the explicit representation will provide continuity. User likely was referring to the limitations we’ve seen on video-style world models like genie and precursors.
- jcjohns 1mo agoYes, one of the main goals of this model was to keep 3D consistency as the camera moves around; it can do this even without relying on an explicit 3D point cloud or Gaussian splat representation of the scene.
- exe34 1mo agoAmazing! Thanks for explaining!