4 ms·
Take a moment and have a deep breath before you get excited about full 3d reconstruction with a single image. That isn't what this is. Watch the video in the
by wokwokwok 7y ago
Take a moment and have a deep breath before you get excited about full 3d reconstruction with a single image.
That isn't what this is.
Watch the video in the bottom right corner, entitled "Comparison with State of the art".
Now go and rewatch the examples and actually look at the edges of the objects as they move the camera 'a bit'. You'll see a tonne of artifacting. Less, clearly, than the existing state of the art, so I tip my hat to the efforts here.
...but all this is doing is generating an 'empty gap' generated by perspective and then basically using the equivalent of photoshop's content aware fill to fill that gap with plausible pixels.
Since humans don't really pay much attention to edge details, it's quite plausible.
To quote the paper:
> In this work we present a new learning-based method that generates a 3D photo from an RGB-D input.
Ie. This work is taking a depth image as the input and working on that to generate a 3d photo, rebuilding the full content of each 2d layer in the image.
Ie. The output is not a 3d model, it is a series of 2D images at depth intervals, where the occluded content in each layer is in-painted (ie. generated artifically).
(NB. The 'from a single source image' work used here is not novel; they're just using existing approaches to estimate a depth image)
- saagarjha 7y ago> all It might be "all" that it's doing, but it does it quite well and in a way that is quite believable, which is significantly better than what came before, which makes it almost realistic. That's what you said, but the way you said it felt like it lessened the achievement.
- wokwokwok 7y ago> which is significantly better than what came before It's a bit better. That's the point I'm making; it's just incremental improvement on existing process. Read the actual paper, eg. under 'Quantitative comparison'. If you think I'm belittling the effort I'm sorry, that's not my intention; ...but, for example, the other comments talking about using it to generate a full 3d model to display on a looking glass surface, or in VR displays a total lack of understanding of what has been achieved here.