4 ms·
Perhaps they can process the image; We already do it with document scans from off-angle.
by zeusk 8y ago
Perhaps they can process the image; We already do it with document scans from off-angle.
- xur17 8y agoWouldn't this require repositioning the person's eyes in the video? Not saying that isn't doable..
- zeusk 8y agoNo, users look at where the other person is on the screen; not at the camera. So reprojection can be done to a known point of view. IIRC, hololens does some of the reprojection magic already.
- monkeynotes 8y agoIt's hurting my brain to think about this. Surely if you aren't looking into the lens then your eyes will not appear as if they are looking at the person since the lens's perspective is the source for the projection on the other side. Like, if I take a picture of myself with a camera and look directly into the lens then my eyes are pointing directly forward. If I now continue looking at that same point but move the camera up on a step-ladder, the image I am going to get would not have my eyes aligning directly into the camera. How do you get around that?
- Kenji 8y agoYes, and there are already AI/Machine learning solutions for this problem. The paper detailing this must be a few years old already.
- AdamTReineke 8y agoI doubt they're doing that, but it can be done realtime. Here's an example that runs in your browser, just move your mouse around and her eyes track it. http://alteredqualia.com/xg/examples/gaze_dolores.html http://alteredqualia.com/xg/examples/gaze_dolores.html [Edit: Disclaimer, I work at MS but not on Surface. I also don't know if there is post-processing applied to the video I linked, so maybe it can't be done realtime.]
- xur17 8y agoThank you for the link - that's pretty awesome.