3 ms·

The results seem quite bad. Compare the static image and "game" in this one example: Static Image: https://lh3.googleusercontent.com/c0GV4hG0Xg0eqpsUS1z62v6aJ2

The results seem quite bad. Compare the static image and "game" in this one example: Static Image: https://lh3.googleusercontent.com/c0GV4hG0Xg0eqpsUS1z62v6aJ2qRGYKmmyJLbpfp1DbJ92elZ_lAvQpx4WSBVKbDO97OBvc0rhu_gNhXbzI_Uv121_QkX9Ur6m3MhMINg8kJ35RMNlA2lxQ2fIuennhBaQ=w1280 https://lh3.googleusercontent.com/c0GV4hG0Xg0eqpsUS1z62v6aJ2... "Game": https://lh5.googleusercontent.com/L_WsAa1saPmj29DSKda_fzk15y2Qk2Rvh3-b-4-n6EdXgaMJ6DrF5Chp3Oh9Nd6Pzz9IfmEwRJnM1t18zo2bsS9nNxpY1sr3pVJabbM-n1jf2bNbVAX9QEQiKlfcNYoQWQ=w1280 https://lh5.googleusercontent.com/L_WsAa1saPmj29DSKda_fzk15y... In the video, the character becomes a pixelated mess. In the static image, the character is clearly on rocks in the foreground, but in the "game" we see the character magically jumping from the foreground rocks to the background structure which also contains significant distortions. The extremely short demo videos make it slightly harder to catch these obvious issues.

polygamous_bat 3y ago
What is the video resolution, 64x64? And even then it becomes blurry. Seems like another Google flag-plant-y paper filled with hot air that we will never see the source code or model for because it will expose how poor its capabilities are relative to competitors. The internal politics at these places must be exhausting. Industry research was supposed to be free from the publish or perish mindset, but it seems like it just got replaced by a different kind of need for posturing.
- jparkerholder 3y ago
  Hey author here :) First, tough crowd, love it, always great to get feedback because we are actively working on improving the model. We are very happy to admit it is not perfect, but given not many people thought this was possible a year ago, I am quite excited to see the next step of improvement. This is like the GPT1 of foundation world models, and we have a fair few ideas in the works to speed up progress. The resolution is 90p but we use an upsampler to make it 360p for examples on the website.
  - nullptr_deref 3y ago
    How can I get started with this kind of research? Is it even possible without a PhD? Thanks.
    - jparkerholder 3y ago
      If we did a good job then the paper should be written in a way that is digestible. When you don't understand things, follow the references to learn more (and there's probably videos covering most of the components we use). In the Appendix we have a case study that should be possible to re-implement and run with a single GPU/TPU. We are hoping the community can build from that and innovate. If you take these steps and get stuck, feel free to get in touch!

polygamous_bat 3y ago

What is the video resolution, 64x64? And even then it becomes blurry. Seems like another Google flag-plant-y paper filled with hot air that we will never see the source code or model for because it will expose how poor its capabilities are relative to competitors. The internal politics at these places must be exhausting. Industry research was supposed to be free from the publish or perish mindset, but it seems like it just got replaced by a different kind of need for posturing.

jparkerholder 3y ago
Hey author here :) First, tough crowd, love it, always great to get feedback because we are actively working on improving the model. We are very happy to admit it is not perfect, but given not many people thought this was possible a year ago, I am quite excited to see the next step of improvement. This is like the GPT1 of foundation world models, and we have a fair few ideas in the works to speed up progress. The resolution is 90p but we use an upsampler to make it 360p for examples on the website.
- nullptr_deref 3y ago
  How can I get started with this kind of research? Is it even possible without a PhD? Thanks.
  - jparkerholder 3y ago
    If we did a good job then the paper should be written in a way that is digestible. When you don't understand things, follow the references to learn more (and there's probably videos covering most of the components we use). In the Appendix we have a case study that should be possible to re-implement and run with a single GPU/TPU. We are hoping the community can build from that and innovate. If you take these steps and get stuck, feel free to get in touch!