3 ms·

I think the key difference is how the eyes are “reanimated” in the deepfakes. Rendering realistic eyes (with that trademark “spark of life”) has always been a c

I think the key difference is how the eyes are “reanimated” in the deepfakes. Rendering realistic eyes (with that trademark “spark of life”) has always been a challenge in real life emulating CGI, but now these new clips kind of capture the spark in the actors eyes much better. Luke Skywalker's eyes in the original clip kind of look dead plastic, the kind you’d find in real-time gameplay (not to mention this nose also looks like the product of bad rhinoplasty). The deepfake does this much better, in my opinion. Elsewhere in this thread, someone posted a similar comparison clip about The Irishman and the difference is even more pronounced there. De Niro’s eyes actually look the age they’re supposed to be in that scene. The original scene had two key problems, in my option; one, they decided not to touch the eye and focused on smoothening the skin (I assume this is because of the technical limitations of doing the deaging in painstaking CGI); two, and this is a little more of a mystery, is that they thought they could get away with using De Niro’s current 80 year old voice on a character that is supposed to be 35 (ages are ballpark numbers). The raspy voice of an old man is just not something you expect out of a supposedly much younger and healthier man. They should have just gotten a voice actor who could do a convincing impression of De Niro in the 70s and dubbbed him in.

Multicomp 5y ago
> (with that trademark “spark of life”) h This was the big winner for me. The deepfake had "Tarkin" and "Leia" on screen. The originals had 3D GCI (very good CGI, but CGI) with dead eyes. To further my anecdoe, I totally missed Leia's sequence the first watch through because I was watching the content and zoned out, forgetting to evaluate her face for deepfake pixels because it looked real enough for me to suspend disbelief. I have never been able to look at Leia's face in the original Rogue One scene without forcing myself to say "they did their best, they'll redo it someday for the 8K release, until then grin and bear the dead eyes".
yourenotsmart 5y ago
> They should have just gotten a voice actor who could do a convincing impression of De Niro in the 70s and dubbbed him in. The director's focus was on the most genuine De Niro expression, not on the most impressive young De Niro impression. Scorsese doesn't make tech demos, he makes stories with characters, and he respects his actors a great deal. What could've been done here is use another AI technology, deepfake for voice, basically, train it on young De Niro's voice, and then reproduce De Niro's own lines with his younger voice, using the original lines as input (not just text). No voice actor could match a performance THAT closely as AI can these days.

Multicomp 5y ago

> (with that trademark “spark of life”) h This was the big winner for me. The deepfake had "Tarkin" and "Leia" on screen. The originals had 3D GCI (very good CGI, but CGI) with dead eyes. To further my anecdoe, I totally missed Leia's sequence the first watch through because I was watching the content and zoned out, forgetting to evaluate her face for deepfake pixels because it looked real enough for me to suspend disbelief. I have never been able to look at Leia's face in the original Rogue One scene without forcing myself to say "they did their best, they'll redo it someday for the 8K release, until then grin and bear the dead eyes".

yourenotsmart 5y ago

> They should have just gotten a voice actor who could do a convincing impression of De Niro in the 70s and dubbbed him in. The director's focus was on the most genuine De Niro expression, not on the most impressive young De Niro impression. Scorsese doesn't make tech demos, he makes stories with characters, and he respects his actors a great deal. What could've been done here is use another AI technology, deepfake for voice, basically, train it on young De Niro's voice, and then reproduce De Niro's own lines with his younger voice, using the original lines as input (not just text). No voice actor could match a performance THAT closely as AI can these days.