4 ms·

In the future you could train a model to predict the correct mesh for a given image. Then things get interesting!

• moron4hire 6y ago
  That's what they are doing. The rest of the process is not novel.
  • yorwba 6y ago
    They're not trying to get the correct mesh, they just treat everything as part of one big continuous surface. That's good enough for sideways views, but fails if you try to look behind objects, because in their approach, there's no "behind", just a big, stretchy sheet covering everything. A model with more knowledge about the world would be able to predict that a tree trunk is roughly cylindrical and not connected to the background.
    • jack_riminton 6y ago
      I think this is what they were referring to when they mentioned GANs This paper does a good job of guessing what should go in a scene when given depths and shapes https://www.youtube.com/watch?v=u4HpryLU-VI&ab_channel=TwoMinutePapers https://www.youtube.com/watch?v=u4HpryLU-VI&ab_channel=TwoMi... A combination of the two would be wild