4 ms·
> since it is trained to simulate the real world Is it though? Or is this just marketing?
by lucisferre 3y ago
> since it is trained to simulate the real world
Is it though? Or is this just marketing?
- rdedev 3y agoIf it is its not there yet. The snow in the mammoth video kind of looks like smoke, the way it rises into the air
- wilg 3y agoI think it's just inherent to the problem space. Obviously it understands something about the world to be able to generate convincing depictions of it.
- lucisferre 3y agoIt seems very dangerous to assume claims without evidence are obvious.
- wilg 3y agoI didn't do that.
- deleted 3y ago[deleted]
- nopinsight 3y agoWhat other likely reasons might explain the leap ahead of other significant efforts? See also: https://news.ycombinator.com/item?id=39387333 https://news.ycombinator.com/item?id=39387333
- lucisferre 3y agoJust having a better or bigger model? Better training data, better feedback process, etc. Seems more likely then "it can simulate reality". Also I take anecdotal reviews like that with a grain of salt. I follow numerous AI groups on Reddit and elsewhere and many users seem to have strong opinions that their tool of choice is the best. These reviews are highly biased. Not to say I'm not impressed, but it's just been released.
- nopinsight 3y agoObject persistence and consistency are not likely to arise simply from a bigger model. A different approach or architecture is needed. Also, I just added a link to an expert’s tweet above. What do you think?
- deleted 3y ago[deleted]
- lucisferre 3y agoOthers have provided explanations for things like object persistence, for example keeping a memory of the rendering outside of the frame. The comment from the expert is definitely interesting and compelling, but clearly still speculation based on the following comment. > I won't be surprised if Sora is trained on lots of synthetic data using Unreal Engine 5. It has to be! I like the speculation though, the comments provide some convincing explanations for how this might work. For example, the idea that it is trained using synthetic 3-dimensional data from something like UE5 seems like a brilliant idea. I love it. Also in his example video the physics look very wrong to me. The movement of the coffee waves are realistic-ish at best. The boat motion also looks wrong and doesn't match up with the liquid much of the time.
- janalsncm 3y agoI was impressed with their video of a drone race on Mars during a sunset. In part of the video, the sun is in view, but then the camera turns so it’s out of view. When the camera turns back, the sun is where it’s supposed to be.
- djsavvy 3y agothere's mention of memory in the post — the model can remember where it put objects for a short while, so if it pans away and pans back it should keep that object "permanence".
- hbn 3y agoWell the video in the weaknesses section with the archeologists makes me think it's not just predicting pixels. The fact that a second chair spawns out of nothing looks like a typical AI uncanny valley mistake you'd expect, but then it starts hovering which looks more like a video game physics glitch than an incorrect interpretation of pixels on screen.