3 ms·

iPhones solve the camera angle by changing the position of the pupil in software instead.

by boxed 3y ago

NooneAtAll3 3y ago
1986 solution vs cyberpunk solution how did we even get here?
marcellus23 3y ago
Are you sure? I remember that being present briefly in a beta several years ago, but then it was removed. I don't remember it ever coming back.
- k1t 3y ago
  Some searching says it was trialed in iOS 13 betas, but didn't make it into the final cut. It was released with iOS 14 though. https://ios.gadgethacks.com/how-to/disable-facetimes-creepy-eye-contact-feature-ios-14-so-you-dont-look-like-youre-staring-awkwardly-0340550/ https://ios.gadgethacks.com/how-to/disable-facetimes-creepy-...
  - marcellus23 3y ago
    Oh, TIL.
deleted 3y ago
[deleted]
jameshart 3y ago
Given that this will probably only produce a relatively low res, high SNR image, it might be the sweet spot is to use this tech to capture a true eye-contact perspective from the glass in front of a screen, then neural net combine it with images from offset cameras, to create a 'true' through-the-screen view.
- cushpush 3y ago
  why stop there? one rendering for each eyeball
bilsbie 3y ago
It’s a bit uncanny valley though, right?
- cal85 3y ago
  I’ve never noticed it, so apparently not.
- bentcorner 3y ago
  Nvidia Broadcast has a similar feature but it's really bad and completely unusable if you wear glasses. I don't have an iPhone to compare.
  - perryizgr8 3y ago
    It seems to work fine with glasses for me. Only it loses tracking if I look too far away (bottom of the monitor). Also it thinks I have olive green eyes for some reason.
hammock 3y ago
Which versions of iphones do this?
- 05 3y ago
  Any model newer than iPhone X (XR/XS and up). It's a Facetime exclusive, though - no API so other videoconferencing apps can't use that.
godelski 3y ago
Having the screen be the camera 1) removes the need for the holepunch as well as magic island workaround 2) could clearly be used in tandem to improve the effect, even potentially reducing the required computation. Sure, Google also fixes images in post, but that's still not a substitute for better cameras. You're always information limited.
gitinit 3y ago
I believe Nvidia offers something similar with Nvidia Broadcast[0]. [0] https://www.nvidia.com/en-us/geforce/broadcasting/broadcast-app/ https://www.nvidia.com/en-us/geforce/broadcasting/broadcast-...
Wowfunhappy 3y ago
This doesn't solve the issue, because it looks like the person is always making eye contact! You don't want that—you want it to look like the person is making eye contact only when they are actually making eye contact. Constant eye contact is exhausting.
doodlesdev 3y ago
It does what??? How have I never heard about this before? Is this deployed right now? Is it always enabled? I have so many questions, don't even know where to start. That sounds amazing.

iPhones solve the camera angle by changing the position of the pupil in software instead.

by boxed 3y ago

iPhones solve the camera angle by changing the position of the pupil in software instead.

NooneAtAll3 3y ago

1986 solution vs cyberpunk solution how did we even get here?

marcellus23 3y ago

Are you sure? I remember that being present briefly in a beta several years ago, but then it was removed. I don't remember it ever coming back.

k1t 3y ago
Some searching says it was trialed in iOS 13 betas, but didn't make it into the final cut. It was released with iOS 14 though. https://ios.gadgethacks.com/how-to/disable-facetimes-creepy-eye-contact-feature-ios-14-so-you-dont-look-like-youre-staring-awkwardly-0340550/ https://ios.gadgethacks.com/how-to/disable-facetimes-creepy-...
- marcellus23 3y ago
  Oh, TIL.

deleted 3y ago

[deleted]

jameshart 3y ago

Given that this will probably only produce a relatively low res, high SNR image, it might be the sweet spot is to use this tech to capture a true eye-contact perspective from the glass in front of a screen, then neural net combine it with images from offset cameras, to create a 'true' through-the-screen view.

cushpush 3y ago
why stop there? one rendering for each eyeball

bilsbie 3y ago

It’s a bit uncanny valley though, right?

cal85 3y ago
I’ve never noticed it, so apparently not.
bentcorner 3y ago
Nvidia Broadcast has a similar feature but it's really bad and completely unusable if you wear glasses. I don't have an iPhone to compare.
- perryizgr8 3y ago
  It seems to work fine with glasses for me. Only it loses tracking if I look too far away (bottom of the monitor). Also it thinks I have olive green eyes for some reason.

hammock 3y ago

Which versions of iphones do this?

05 3y ago
Any model newer than iPhone X (XR/XS and up). It's a Facetime exclusive, though - no API so other videoconferencing apps can't use that.

godelski 3y ago

Having the screen be the camera 1) removes the need for the holepunch as well as magic island workaround 2) could clearly be used in tandem to improve the effect, even potentially reducing the required computation. Sure, Google also fixes images in post, but that's still not a substitute for better cameras. You're always information limited.

gitinit 3y ago

I believe Nvidia offers something similar with Nvidia Broadcast[0]. [0] https://www.nvidia.com/en-us/geforce/broadcasting/broadcast-app/ https://www.nvidia.com/en-us/geforce/broadcasting/broadcast-...

Wowfunhappy 3y ago

This doesn't solve the issue, because it looks like the person is always making eye contact! You don't want that—you want it to look like the person is making eye contact only when they are actually making eye contact. Constant eye contact is exhausting.

doodlesdev 3y ago

It does what??? How have I never heard about this before? Is this deployed right now? Is it always enabled? I have so many questions, don't even know where to start. That sounds amazing.