4 ms·

Keep in mind that these are stills. Once the motion starts, humans detect the not-quite-realness easily. Even the 2D video creations by AI aren’t stitched corre

Keep in mind that these are stills. Once the motion starts, humans detect the not-quite-realness easily. Even the 2D video creations by AI aren’t stitched correctly, let alone getting all the details of an animated 3D person right.

dylan604 8y ago
They are getting closer, but I do agree that it is still not quite there. It's pretty common practice now at the beginning of each film production to do full image capture of all of the main talent. It's a back up in case something untoward happens that the film can still be finished by using their 3D likeness.
- cm2187 8y ago
  You mean for an Oliver Reed/Gladiator scenario?
  - ptrott2017 8y ago
    More commonly for postproduction fixes (think stunts and inserting talent likeness, relighting/reframing a shot, inserting reflections when CG-ing the background of a window etc.…) so you can fix sequences without having to recall talent which can produce availability delays and additional expense beyond what it takes to fix digitally.
agumonkey 8y ago
It used to be the case but even with not too recent CGI tech they can make ~alright main characters (see SW ep. VII). With the most recent siggraph tricks I'm sure most of the population won't notice (if not abused).
- delinka 8y ago
  Good CGI tools in the hands of a talented human can make for good results.
  - agumonkey 8y ago
    Oh yeah don't misread me, I'm not asking for fancier tech. Movies != CGI, far from that. I cry when I compare old movies that had flesh to the hyper hectic pixel fest of today..
    - FiveSquared 8y ago
      No cgi no cry
computerex 8y ago
https://goo.gl/Z5KnrZ https://goo.gl/Z5KnrZ https://youtu.be/9Yq67CjDqvw https://youtu.be/9Yq67CjDqvw
- hellofunk 8y ago
  Lip-synching is quite different from full body motion. And what you have posted is actually using original real source video for most of the pixels if I understand correctly.
  - computerex 8y ago
    I was mainly responding to the parent's comment: > Keep in mind that these are stills. Once the motion starts, humans detect the not-quite-realness easily. Even the 2D video creations by AI aren’t stitched correctly, let alone getting all the details of an animated 3D person right. I agree this isn't end to end video synthesis but the end results are still very impressive and realistic. I can easily imagine this type of technology being a problem, because video evidence will be devalued and mean nothing. They basically just animate Obama's lips using a RNN and then composite the output onto a target video of Obama to change the appearance of what he is saying. Yes they aren't generating all of Obama's head yet but this result in itself is impressive. Also I can't wait to see where GAN's take us 10-20 years down the road. Don't forget they are still in their infancy relatively speaking.
lambdadmitry 8y ago
Even in those stills (cherry-picked for sure) it's easy to spot NN artifacts, it's just that most people on HN trained themselves to spot "classic" CGI problems that are local. Check the general geometry and long-distance order, that's what problematic for NN because of their nature. Even using photos as references NNs can't avoid shifting ears or gaze or warping faces because there's no concept of the underlying 3D object there, just a bunch of flat transformations.

dylan604 8y ago

They are getting closer, but I do agree that it is still not quite there. It's pretty common practice now at the beginning of each film production to do full image capture of all of the main talent. It's a back up in case something untoward happens that the film can still be finished by using their 3D likeness.

cm2187 8y ago
You mean for an Oliver Reed/Gladiator scenario?
- ptrott2017 8y ago
  More commonly for postproduction fixes (think stunts and inserting talent likeness, relighting/reframing a shot, inserting reflections when CG-ing the background of a window etc.…) so you can fix sequences without having to recall talent which can produce availability delays and additional expense beyond what it takes to fix digitally.

agumonkey 8y ago

It used to be the case but even with not too recent CGI tech they can make ~alright main characters (see SW ep. VII). With the most recent siggraph tricks I'm sure most of the population won't notice (if not abused).

delinka 8y ago
Good CGI tools in the hands of a talented human can make for good results.
- agumonkey 8y ago
  Oh yeah don't misread me, I'm not asking for fancier tech. Movies != CGI, far from that. I cry when I compare old movies that had flesh to the hyper hectic pixel fest of today..
  - FiveSquared 8y ago
    No cgi no cry

computerex 8y ago

https://goo.gl/Z5KnrZ https://goo.gl/Z5KnrZ https://youtu.be/9Yq67CjDqvw https://youtu.be/9Yq67CjDqvw

hellofunk 8y ago
Lip-synching is quite different from full body motion. And what you have posted is actually using original real source video for most of the pixels if I understand correctly.
- computerex 8y ago
  I was mainly responding to the parent's comment: > Keep in mind that these are stills. Once the motion starts, humans detect the not-quite-realness easily. Even the 2D video creations by AI aren’t stitched correctly, let alone getting all the details of an animated 3D person right. I agree this isn't end to end video synthesis but the end results are still very impressive and realistic. I can easily imagine this type of technology being a problem, because video evidence will be devalued and mean nothing. They basically just animate Obama's lips using a RNN and then composite the output onto a target video of Obama to change the appearance of what he is saying. Yes they aren't generating all of Obama's head yet but this result in itself is impressive. Also I can't wait to see where GAN's take us 10-20 years down the road. Don't forget they are still in their infancy relatively speaking.

lambdadmitry 8y ago

Even in those stills (cherry-picked for sure) it's easy to spot NN artifacts, it's just that most people on HN trained themselves to spot "classic" CGI problems that are local. Check the general geometry and long-distance order, that's what problematic for NN because of their nature. Even using photos as references NNs can't avoid shifting ears or gaze or warping faces because there's no concept of the underlying 3D object there, just a bunch of flat transformations.