5 ms·

One thing that’s missing in video calls is eye contact. You both are looking at each other’s faces, which are not the camera. Seems like it would be possible

by meken 4y ago

One thing that’s missing in video calls is eye contact. You both are looking at each other’s faces, which are not the camera. Seems like it would be possible to transform the person’s eyes so they’re looking straight forward, not down. This matters more in applications like therapy over video calls.

mkmk 4y ago
Apple has this feature, although it’s unclear to me how widely deployed it is. https://www.fastcompany.com/90372724/welcome-to-post-reality-apple-will-now-fake-your-eye-contact-in-facetime https://www.fastcompany.com/90372724/welcome-to-post-reality...
kimburgess 4y ago
Apple already do. One of the advantages of having a know physical design. See https://twitter.com/WSig/status/1146146914985009154 https://twitter.com/WSig/status/1146146914985009154 and https://twitter.com/schukin/status/1146359923158089728 https://twitter.com/schukin/status/1146359923158089728. NVIDIA also have an implementation in their Maxine SDK (https://developer.nvidia.com/maxine#ar-sdk https://developer.nvidia.com/maxine#ar-sdk).
- hammock 4y ago
  Now I wonder what the unintended effect of this deepfaked eye contact is on the conversation. Breaking eye contact, in a variety of different ways, is an important part of body language
  - imgabe 4y ago
    Isn't there already eye-tracking software that can tell where you're looking? If you can fake the eye position, why not keep faking it to track if the person looks away?
  - gilbertbw 4y ago
    The impression I get from those tweets is that it’s not making the eye look as it it’s always looking at the camera, it’s just adjusting so that if you look at the screen (the persons eyes in e.g. FaceTime) it looks like you are looking at the camera. So if you break eye contact with the image of the person on the screen, it will show you breaking eye contact in your video.
bqmjjx0kac 4y ago
> Seems like it would be possible to transform the person’s eyes so they’re looking straight forward, not down. This could be terrifying when it goes wrong.
- hansel_der 4y ago
  it is

by meken 4y ago

mkmk 4y ago

Apple has this feature, although it’s unclear to me how widely deployed it is. https://www.fastcompany.com/90372724/welcome-to-post-reality-apple-will-now-fake-your-eye-contact-in-facetime https://www.fastcompany.com/90372724/welcome-to-post-reality...

kimburgess 4y ago

Apple already do. One of the advantages of having a know physical design. See https://twitter.com/WSig/status/1146146914985009154 https://twitter.com/WSig/status/1146146914985009154 and https://twitter.com/schukin/status/1146359923158089728 https://twitter.com/schukin/status/1146359923158089728. NVIDIA also have an implementation in their Maxine SDK (https://developer.nvidia.com/maxine#ar-sdk https://developer.nvidia.com/maxine#ar-sdk).

hammock 4y ago
Now I wonder what the unintended effect of this deepfaked eye contact is on the conversation. Breaking eye contact, in a variety of different ways, is an important part of body language
- imgabe 4y ago
  Isn't there already eye-tracking software that can tell where you're looking? If you can fake the eye position, why not keep faking it to track if the person looks away?
- gilbertbw 4y ago
  The impression I get from those tweets is that it’s not making the eye look as it it’s always looking at the camera, it’s just adjusting so that if you look at the screen (the persons eyes in e.g. FaceTime) it looks like you are looking at the camera. So if you break eye contact with the image of the person on the screen, it will show you breaking eye contact in your video.

bqmjjx0kac 4y ago

> Seems like it would be possible to transform the person’s eyes so they’re looking straight forward, not down. This could be terrifying when it goes wrong.

hansel_der 4y ago
it is