2 ms·
It can, I've tried gaze correction software, but it has the unfortunate side effect of making the speaker look possessed. Total uncanny valley. We humans are s
by crazygringo 6y ago
It can, I've tried gaze correction software, but it has the unfortunate side effect of making the speaker look possessed. Total uncanny valley.
We humans are sensitive to every tiny detail of the eye, because we express so much emotion through it. It's no joke that the "eye is the window to the soul". Gaze correction software literally winds up looking like it messes with your soul.
Maybe someday we'll invent gaze correction that actually looks realistic -- but because it involves not just moving the eyeball, but opening/closing the eyelid (the eyelid moves as our eyes move vertically, like for a webcam), therefore moving the eyelashes, involving compensation with the lower eyelid, and more... it's going to be really hard.
- blululu 6y agoI recall once having a conversation with someone working on computer vision at Facebook, and they mentioned that the company had spent a considerable amount of talent & resources trying to get this feature to work cleanly and they did not get past the uncanny valley problems.
- cma 6y agoGaze redirection looks bad partly because head orientation ends up decoupling from eye direction. With a depth camera you can move the camera's entire vantage point as if it were behind the right area on screen. Hat's probably a better approach, along with AI filling in the disocclusions (more cameras can also do this).