4 ms·
Ahhh coool. I didn't know they had this PDAF thing to get stereo images. I remember when they released their first round of this for the old cameras, where you
by a-dub 8y ago
Ahhh coool. I didn't know they had this PDAF thing to get stereo images. I remember when they released their first round of this for the old cameras, where you were required to smoothly swipe the camera over to the side and (I'm assuming) they used optical flows + accelerometer data to get two source locations for stereo stuff.
Interesting application of object detection/segmentation to make up for a weak depth map from the PDAF, but I have to wonder, if you're constraining yourself to portraits and are doing a pretty good job of detecting the person, I wonder how well you could do without the stereo depth data at all...
- a-dub 8y agoA fun experiment would be to try to build something that predicts complete depth maps from single images alone. (ie: train on images with stereo depth maps, try to predict them from just one side)
- sorenjan 8y agoCalled depth estimation from single image. There's ongoing research, here's one example: [0] Using only the segmented 2D image is what the selfie cam does by the way, at least on Pixel 2 [1]. [0] https://papers.nips.cc/paper/5539-depth-map-prediction-from-a-single-image-using-a-multi-scale-deep-network.pdf https://papers.nips.cc/paper/5539-depth-map-prediction-from-... [1] https://ai.googleblog.com/2017/10/portrait-mode-on-pixel-2-and-pixel-2-xl.html https://ai.googleblog.com/2017/10/portrait-mode-on-pixel-2-a...
- a-dub 8y agoCool!
- state_less 8y agoIt would be fun to estimate depth maps from single images. And for the next act, estimate scene graphs from a single image where the understanding of what is being looked at and the position is estimated. For example, a fingernail connected to a jointed finger, connected to a hand, to an arm, to a body and so on. With dimensions, locations and rotations relative to each other. One could render a humanoid model at 120 frames (or whatever the gpu would allow) a second using a set of estimated scene graphs trying to minimize error between the image and the rendering. Add more models (tvs, cars, signs, letters, etc...) over time if the technique shows promise.
- deleted 8y ago[deleted]
- IshKebab 8y agoThey don't use stereo depth data for the front facing camera.