3 ms·

This is really cool work. I'm not sure about anyone else, but this doesn't get past the Uncanny Valley for me.

• theptip 10y ago
  I really liked the approach that Oculus are taking and which Zuck demo'd last year[1], with cartoon avatars that are still expressive enough to convey facial expressions. It definitely falls on the other side of the uncanny valley, and anyway, who is going to want to render a realistic version of themselves into the VR world, when you can be <insert favourite person/creature/character>? That said the tech in the OP is very cool, and I can see plenty of use cases (e.g. business meetings or celebrity broadcasts). [1]: https://www.facebook.com/zuck/videos/10103154531425531/ https://www.facebook.com/zuck/videos/10103154531425531/
  • carlosdp 10y ago
    Well that's designed for in-VR avatars, this method is designed for mixed reality videos (VR footage with the real-world person superimposed on it)
  • gwern 10y ago
    In the FB video, I think the facial expressions were like emoticons: they had to be manually invoked. This approach could do it automatically in realtime, by mapping the facial movements onto a cartoon avatar (probably easier than onto the real face).
    • theptip 10y ago
      Interesting, do you have a source for that info, or is that a guess? Watching the video the eyebrow movements look a bit twitchy, I'd assumed they were face-tracking them. I have no supporting evidence beyond watching the video, so I'd be interested to know more details either way.