6 ms·
I'm excited for transparent OLED's simply so that laptops and monitors will be able to put the webcam behind the display, ~1/3 from the top. Then videoconferen
by crazygringo 6y ago
I'm excited for transparent OLED's simply so that laptops and monitors will be able to put the webcam behind the display, ~1/3 from the top.
Then videoconferencing software can automatically move the image of the person you're talking to so their eyes are roughly centered on that point.
And finally everyone gets to make direct eye contact again!
- xwdv 6y agoAnd then we fall into the uncanny valley and go back to how it used to be with no eye contact.
- crazygringo 6y agoNot sure what you mean? I've used prototypes of this and there's nothing uncanny whatosever about it. It's seriously great. You can test it yourself one-way by just asking a friend to look into their webcam when talking to you. On your side, it'll look totally normal.
- mrfusion 6y agoI’m curious why software can’t correct this now? Messenger can make me look like a sheep, can’t it move my gaze?
- rwc 6y agoAvailable in FaceTime: https://appleinsider.com/articles/20/06/22/facetime-eye-contact-correction-feature-to-launch-with-ios-14 https://appleinsider.com/articles/20/06/22/facetime-eye-cont...
- crazygringo 6y agoIt can, I've tried gaze correction software, but it has the unfortunate side effect of making the speaker look possessed. Total uncanny valley. We humans are sensitive to every tiny detail of the eye, because we express so much emotion through it. It's no joke that the "eye is the window to the soul". Gaze correction software literally winds up looking like it messes with your soul. Maybe someday we'll invent gaze correction that actually looks realistic -- but because it involves not just moving the eyeball, but opening/closing the eyelid (the eyelid moves as our eyes move vertically, like for a webcam), therefore moving the eyelashes, involving compensation with the lower eyelid, and more... it's going to be really hard.
- blululu 6y agoI recall once having a conversation with someone working on computer vision at Facebook, and they mentioned that the company had spent a considerable amount of talent & resources trying to get this feature to work cleanly and they did not get past the uncanny valley problems.
- cma 6y agoGaze redirection looks bad partly because head orientation ends up decoupling from eye direction. With a depth camera you can move the camera's entire vantage point as if it were behind the right area on screen. Hat's probably a better approach, along with AI filling in the disocclusions (more cameras can also do this).
- namibj 6y agoWhat we have today is called "teleprompter", and not even particularly recent. With some slight pre-distortion and a tilted monitor it should also handle the focus issue a classic teleprompter setup has. Basically, you just place a half-reflective mirror at a 45 degree angle, lay the screen flat facing up (I propose a slight back-tilt "so the camera can see better", but you loose contrast due to viewing angle, which would ideally be corrected by the LCD), and look at the camera that's behind the mirror, while being able to view the screen in the mirror.
- gopalv 6y ago> put the webcam behind the display The first time I saw an optical finger print sensor under a glass display, that was my immediate hope that it would kick off an under-glass optics explosion. > everyone gets to make direct eye contact again! As someone who doesn't always have "good" days with eye-contact, being forced to do that feels a bit terrifying.
- p1esk 6y agoAs someone who doesn't always have "good" days with eye-contact Same here. In addition, I find when I'm forced to make eye contact for a prolonged time (> 2 min), my eyes get exhausted.
- nmstoker 6y agoCould you have got the wrong idea about eye contact? People don't generally make sustained eye contact for multi minute periods. Even 10 seconds is generally viewed as a long time: https://royalsocietypublishing.org/doi/10.1098/rsos.160086 https://royalsocietypublishing.org/doi/10.1098/rsos.160086
- p1esk 6y agoDefinitely not talking about sustained 2 min eye contact. That would have been torture.
- deleted 6y ago[deleted]
- crazygringo 6y agoNobody's forcing you to make eye contact. :) You can still be totally free to not look directly at the person while talking to them. I mean, in normal conversation it's not like you're making constant eye contact anyways. If you did, you'd come across as a total psychopath. It's just so that when you want to make eye contact, you have that choice!
- 6y ago
- ISL 6y agoIf you don't want to wait for eye-contact and have two monitors, you can place the webcam between the monitors and center your conversation-partner's image/window on the camera. Works great.
- jjcm 6y agoI think that’s a poor approach. While you end up with gaze more in the center of the display, you don’t always have a face directly centered. This alleviates some of the problem, but doesn’t remove it. A better approach that I’ve always wanted is to have four cameras on the corners of the display that generate a real time photogrametric projection of your face. This would mean not only would your camera view be dead center, it’d be center no matter where you were looking on the screen. Much better especially in situations where there are multiple people in a meeting. You could even have different streams for each meaning to the other attendees it appeared as if you were looking directly at them only when you actually were.
- tomcam 6y agoOr you can just look at the camera instead of the screen
- Zanni 6y agoThis is surprisingly difficult with a device like an iPad or smartphone in landscape where the camera is off to one side. Even knowing where the camera is, the image of the person on your screen that you're talking to tends to pull your gaze back. You can do it; it's just an effort.
- c22 6y agoAnd if both parties are doing it you might as well just cut the video.
- crazygringo 6y agoIt would be relatively trivial to automatically keep the face of the person you're talking to centered around the webcam using face detection. As a person moves in frame, your computer will "pan" to keep them centered. Four cameras is intriguing, but also expensive and complicated, and will probably have a very rough time with things like eyelashes, edges of hair, different patterns of reflections on the eyeballs, different glare from lighting, etc. Realistic photogrammetry is really hard in practice, and runs the risk of being really uncanny valley.
- userbinator 6y agoThe thought of a webcam constantly pointing at users has already creeped them out enough to make camera covers a popular item. Imagine how well that segment of the population would react to a hidden camera...
- m463 6y agoI think one solution would be like a purism laptop (and upcoming phone) - hardware switches (they one for camera/mic, one for bt/wifi)
- grawprog 6y agoYes I can see the discussion at hardware manufacturers now. Marketing: 'So, we can monitor users and collect sellable data through a camera hidden behind their monitor?' Engineer: 'Why yes, but maybe we should allow users to disable this through some kind of hardware switch. It could lead to potential privacy violations etc.' Marketing: 'If they turned it off could we still collect marketable data?' Engineer: 'Well no...that's sort of the point...' Marketing: 'I see...so invisible hidden cameras that can't be disabled you say?' '
- JoshTriplett 6y agoEthical engineer: Not if you want anyone to keep working here. Also, it'll make the news. No.
- oivey 6y agoMany, many engineers driven more by money than they want to admit: “well if I don’t do it someone else will.”
- grawprog 6y agoMarketing: Make the news eh? Well any publicity's good publicity and we can outsource these kinds of things can't we? Maybe we could save a bit of money that way. Excellent idea. Get right on it.
- FpUser 6y ago"And finally everyone gets to make direct eye contact again!" And enjoy crappy contrast. For special purposes those transparent displays can be amazingly useful but as a generic monitor, thanks but no thanks.
- pngmangi 6y agoVisionox is already doing this in an upcoming cell phone design: https://www.gizmochina.com/2020/07/01/visionox-under-screen-camera-ready-mass-production/ https://www.gizmochina.com/2020/07/01/visionox-under-screen-...
- Bedon292 6y agoDIY Perks did an interesting mod for this: https://www.youtube.com/watch?v=2AecAXinars https://www.youtube.com/watch?v=2AecAXinars Basically a box and a two way mirror.
- perryizgr8 6y agoI think the OLEDs shipping in Samsung's phones are already transparent to a degree. They are able to put light sensor, proximity sensor and finger print sensor behind the screen. The can see through the screen. It's only a matter of time before they are able to put a full camera behind the display.
- akaBruce 6y agoSomeone correct me if I'm wrong, but would that work? I'm assuming (it wasn't clear) the goal there would be to display the person's whole face in a non-distracting way. But if the OLEDs are transparent and they're projecting the image that person's face, the projection would be both forwards and backwards, so the camera would just capture the space between that person's eyes instead of you. Can transparent OLED's have a unidirectional display?
- sriku 6y agohttps://appleinsider.com/articles/20/06/22/facetime-eye-contact-correction-feature-to-launch-with-ios-14 https://appleinsider.com/articles/20/06/22/facetime-eye-cont... Looks like eye contact correction will come earlier than a hardware upgrade.
- russdill 6y agoA much more general solution would be a neural net that can alter gaze. Integrate with eye tracking and it becomes even better. Only the user you are looking at would see your direct gaze. Other users would see you looking towards the user you are looking at.
- Shivetya 6y agoand here I am the simple science fiction fan who sees us closing in on the possibility of having large portions of our phones being wholly see through, so as with OLED televisions you tuck all your electronics at the bottom and the top half is glorious thin and soon transparent screen
- m4rtink 6y agoPhones in the Expanse are like that. :)
- jp555 6y agoWhy worry about better horse bridles (Webcams) when the automobile is beginning to roll out ($300 PC-free VR)?
- Dylan16807 6y agoVR won't have a picture of your face at all. How does that help with eye contact?
- jp555 6y agoIt will (https://www.youtube.com/watch?v=v3XcQtoja_Y https://www.youtube.com/watch?v=v3XcQtoja_Y), and VR already conveys MUCH more of the micro-interactions of being with people that we are unknowingly blind to in Zoom meetings, which is one reason Zoom meetings are so draining.
- Dylan16807 6y agoHow? At best it can take pictures of part of your face. And usually there's a screen inside that headset. Don't you have the exact same problem of needing a camera to be in the middle of the screen? But now it's even worse because the other person's eyes could be anywhere on the screen as you move your head. Edit: Oh, you have a link now. So it's going to render a fake head based on eye tracking? You can do that without VR!
- jp555 6y agoJust added a video explaining one approach being taken - https://www.youtube.com/watch?v=v3XcQtoja_Y https://www.youtube.com/watch?v=v3XcQtoja_Y And that's over a year ago...
- Dylan16807 6y agoNothing in that depends on a VR headset. You can do that with a normal webcam. It's a completely orthogonal technology.
- sukilot 6y agoWhat do you mean "again"? Who stares into each other's eyes? Is your lover far away?