10 ms·
How iOS 13 redraws your eyes so you're looking at the camera
- bobsil1 7y agoBefore/after images: https://twitter.com/WSig/status/1146146914985009154 https://twitter.com/WSig/status/1146146914985009154
- aetherspawn 7y agoI really want to see this, but I opt out of having a twitter account :(
- jessedhillon 7y agoHere you are http://imgur.com/gallery/m42ogsZ http://imgur.com/gallery/m42ogsZ
- 3JPLW 7y agoHunh? You can view tweets just fine without twitter accounts.
- kabwj 7y agoThis also happens with posts from Facebook often. People just want to show the world how virtuous they are by not having accounts in popular networks, so they don’t even click the link but complain they can’t read the content. Reminds me of this: https://twitter.com/1990sLinuxUser/status/97350916902105089 https://twitter.com/1990sLinuxUser/status/97350916902105089
- aetherspawn 7y agoNot on mobile perhaps? When I click it I just get a sign in page.
- userbinator 7y agoI can't help but think all this image recognition/manipulation tech being silently applied is a tad creepy. IMHO going beyond things like automatic focus/white balance or colour adjustments, and identifying more specific things to modify, crosses the line from useful to creepy.
- viraptor 7y agoIt looks like there's a toggle https://twitter.com/flyosity/status/1146136279647772673 https://twitter.com/flyosity/status/1146136279647772673 But yes, it crosses the line where it's no longer a camera (as a feature, it does not capture reality)
- sjwright 7y agoWhat is truth? When the person on the other end of the call is looking at the image of me on their screen, the physical truth is that they're looking away from the camera, but the emotional truth is that their eyes are looking at me. When I'm chatting with loved ones, which truth is more important? Physical truth, or emotional truth? Consider for a moment that an offset front-facing camera might be just as serious a distortion of truth.
- viraptor 7y agoYou've lost me at "emotional truth". The camera captures a specific scene. The result is processed to correct for lens distortions / colour / lighting issues. But none of those changes the content. I don't think an offset camera is distorting anything. It captures the image it's expected to capture.
- LocalH 7y agoBut it doesn't capture the image the user expects it to capture - when on a Facetime call, they expect (or at least want, if they think about it at all) to be looking directly at the other parties to the call. All this is doing is correcting for that, hence "emotional truth". Reality is always shaped by our emotions and our mental state, and thus there is merit to the idea that a representation of reality that isn't 100% physically accurate can still be closer to what we perceive as reality.
- tomxor 7y agoWeird, what happens when you are actually trying to look at something else?
- asark 7y agoMaybe it still re-paints your eyes, relative to the person's eyes. So you glance down at their mouth and it looks like you're looking at their mouth rather than... down at their chest or something, like it would without the adjustment. Finding eyes in an image is common/boring tech at this point, so I could see that being used to provide a relative adjustment.
- deleted 7y ago[deleted]
- syllable_studio 7y agoInsert image of Clockwork Orange film scene where a machine holds your eyes open and forces you to look.
- dole 7y agohttps://i.imgur.com/Ak6UP4z.jpg https://i.imgur.com/Ak6UP4z.jpg
- anoncake 7y agoYou're looking wrong.
- scotty79 7y agoI was wondering why skype and any other video chat don't do this five years ago, or more. Probably we needed deep learning to do this well.
- ktpsns 7y agoCorrect. Apple certainly "reused" the infrastructure they established with realtime facial recognition and manipulation, all encapsuled in ARKit (https://developer.apple.com/augmented-reality/arkit/ https://developer.apple.com/augmented-reality/arkit/). Furthermore, these compute intensive codes are accelerated with special chips ("AI chip", "Neural engine", etc.). That's actually quite novel stuff which wasn't there five years ago.
- ThePadawan 7y agoSome research achieved basic results in 2012 [0] and spun off into a plugin ("Catch-Eye") [1] which is no longer available (and the website was last updated in 2017). [0] https://cgl.ethz.ch/publications/papers/paperKus12.php https://cgl.ethz.ch/publications/papers/paperKus12.php [1] https://www.catch-eye.com/index.html https://www.catch-eye.com/index.html
- moftz 7y agoYou might also need the FaceID sensor as well. It turns your nose a little bit too apparently so I imagine that it's creating some sort of mask and mapping your facial movements onto it.
- LocalH 7y agoI fail to see how this is creepy (outside of potential uncanny valley issues in edge cases). There is a toggle to disable it, and this is something that most average non-savvy users would either want by default, or wouldn't even notice happening (because the end result will look natural to most). I don't buy the slippery slope argument here, yet. All they're doing is shifting eyes and nose to compensate for physical offset from the camera. Seems like Animoji would be more creepy, as it's capturing your entire face movement.
- phalangion 7y ago> I don't buy the slippery slope argument here, yet. That's how the slippery slopes get you. They look all gentle and inviting at the beginning like you can totally stand on them no problem, then the slippery gets you and you're sliding right on down.
- LocalH 7y agoRight, I understand that. I just don't feel this particular use of the technology pushes us significantly closer to that point.
- moneytalks 7y agoThe real problem with talking about slippery slopes in tech is that we're already on an unrecoverable slide into the unknown. So the question is just "does this new thing make the slide even faster?" Not, "we're on stable ground and we need to be careful about beginning a slide." There's no going back and we have no idea where we're headed.
- gen3 7y agoI agree with you. This seems more like a "quality of usage" type of thing. Now when you look at who your Facetiming, it's like your actually looking at them, instead of their chin. Something like skin smoothing in the regular camera would be worse, in my opinion.
- ubercow13 7y ago
- keiferski 7y agoI am reminded of a brief story about video calls in David Foster Wallace's Infinite Jest. Some excerpts: Good old traditional audio-only phone conversations allowed you to presume that the person on the other end was paying complete attention to you while also permitting you not to have to pay anything even close to complete attention to her...Video telephony rendered the fantasy insupportable. The proposed solution to what the telecommunications industry’s psychological consultants termed Video-Physiognomic Dysphoria (or VPD) was, of course, the advent of High-Definition Masking; Mask-wise, the initial option of High-Definition Photographic Imaging — i.e. taking the most flattering elements of a variety of flattering multi-angle photos of a given phone-consumer and — thanks to existing image-configuration equipment already pioneered by the cosmetics and law-enforcement industries — combining them into a wildly attractive high-def broadcastable composite of a face wearing an earnest, slightly overintense expression of complete attention — was quickly supplanted by the more inexpensive and byte-economical option of (using the exact same cosmetic-and-FBI software) actually casting the enhanced facial image in a form-fitting polybutylene-resin mask, http://declineofscarcity.com/?page_id=2527 http://declineofscarcity.com/?page_id=2527
- carlob 7y agoI also thought about this when I saw it. It's incredible how ahead of the times DFW was!
- tictoc 7y agoYeah this whole snapchat phenomenon with filters is literally out of Infinite Jest. It's almost hilarious how exact he got the fact that people will be talking with each other on the camera, and it will literally be a visually enhanced version of themselves communicating with each other. I mean people have no shame in photoshopping their entire form and passing it off as themselves. We are a sad bunch. Except for the ones who don't comply.
- aloer 7y agoI was very surprised when I downloaded zoom yesterday and noticed that an “appearance enhancement filter” is enabled by default. This is something that I am not used to outside of social and camera apps from (mostly) Asian countries Sad state of the world where the default in a business related App is essentially telling you that this is necessary. Can’t be healthy for society
- jakejarvis 7y agoI understand why this feels creepy in our tech bubble, but I think it's worth noting how popular apps like FaceTune have become the past few years [0] [1]. I'm certainly not defending this trend and I think it's incredibly unhealthy — especially for the average teenager who's already naturally self-conscious about their appearances. But a minor eye correction will be peanuts in the eyes of this crowd (no pun intended) compared to the amount of processing that most of their Instagram and Snapchat photos go through before being uploaded. [0] https://www.theguardian.com/media/2018/mar/09/facetune-photoshopping-app-instagram-body-image-debate https://www.theguardian.com/media/2018/mar/09/facetune-photo... [1] https://abcnews.go.com/GMA/Living/photo-retouching-apps-affect-impressionable-teens-social-media/story?id=56928554 https://abcnews.go.com/GMA/Living/photo-retouching-apps-affe...
- scarejunba 7y agoI love this. What a casual use of futuristic technology to make what people want to express real. Great work from Apple.
- suyash 7y agoSorry I'm not seeing it, can someone explain in bit more detail what is going on?
- dev_256 7y agoThe wire bends when it passes the eyes.
- tantalor 7y agoIt's hard to see. Would have been better to use a straight wire instead of a bendy glasses arm.
- rcv 7y agoOne of the drawbacks of video chat is that the camera on your device is offset from the face of the person that you're chatting with (typically your camera is on top of your screen, rather than embedded in the middle of it). This leaves people chatting with the impression that the person they're chatting with is staring at their neck. This new iOS video chat software modifies your video stream to correct for this camera/screen offset by _redrawing your eyes_. The end effect is that the person you're chatting has the impression that you're looking into their eyes rather than at their neck. The effect is subtle, but can be made more obvious by putting a straight wire in front of your eyes. With the software feature disabled, the wire appears straight. With the software enabled, the wire appears bent.
- suyash 7y agothanks, I get it now and see it now :)
- crazygringo 7y agoHuh. I was on a team that experimented with this a few years ago, and the results were so uncanny-valley that we quickly stopped going down the path -- despite it looking "real", people wound up looking like slightly possessed demons because there was something "just off" about their eyes. I mean, it seriously freaked us out. I'm really wondering if/how iOS avoids this, or if it took a ton of extra work.
- moftz 7y agoI'm just hoping that it will correct my eyes so I can watch TV in the background while my girlfriend thinks I'm looking at her during the videochat.
- valine 7y agoI don't think it works like that. iOS is adjusting your eyes by a specific angle to account for the distance from the screen to the camera. If you look away it will appear to the person on the other end of the call that you are looking away.
- valine 7y agoThe feature is only available on the iPhone Xs so I assume it takes advantage of the iPhone's 3D depth sensing features. When it comes to eye and face tracking Apple has a lot of hardware at their disposal. The photos I've seen so far look perfectly normal, not uncanny at all.
- bartcobain 7y agoThe Simpsons did it again: https://imgur.com/a/oGSkSgN https://imgur.com/a/oGSkSgN
- lquist 7y agoThis is such an elegant solution! Previous discussions about how to solve this issue revolved around putting a camera in the center of the phone behind the screen!
- kazinator 7y agoI asked for this: https://news.ycombinator.com/item?id=12165812 https://news.ycombinator.com/item?id=12165812 :)
- ben_w 7y agoNice to see this feature. A few months ago I made a demo app for my own personal use which did this exact thing, just to see if it would work. As I was still learning AR at the time, I didn’t fully understand the API well enough and I just had a point cloud with loads of holes in it, but it still showed it worked, and made me wonder why Apple hadn’t already done it.
- jokoon 7y agoI had a video call interview and I was quite impressed how that woman always seemed to look at the camera, because I really thought she was looking at me and not me on the screen. I told her, but she answered that she was not really staring at the camera. I guess it makes sense now.
- Waterluvian 7y agoOff topic: anyone know why 100% of the time I load a Twitter post from HN it loads "something has gone wrong" and I must refresh the page once to see the tweet?