5 ms·

Deepfake 'Silence of the Lambs' with Willem Dafoe and Gillian Anderson [video]

87 points by laurex 7y ago

colordrops 7y ago
It's not really an improvement on many of the others out there. It has some of the same problems as well, such as oddly smooth skin tone, deformed or blurry ears, and the face looking like a morph with the original rather than completely different. It seems that some deep fake authors try to find faces similar to the original to make the deep fakes work.
01100011 7y ago
Direct link to youtube: https://www.youtube.com/watch?v=XJB5W2beVZ0 https://www.youtube.com/watch?v=XJB5W2beVZ0
- signa11 7y ago
  thanks ! the thing that ever so _slightly_ ruined it (for me atleast) were the eyes of the characters. they were just plain and utterly white without any blood-vessels. once i noticed that, it became kind of hard to ignore.
galago 7y ago
Its the original audio performances, and I think this shows how important the actors are. Test deep fakes only on image and I think they fall down a lot.
- droopyEyelids 7y ago
  When Dr Fakenstein drops a video, he does the voice AND the face. Really missing that, here.
- e_proxus 7y ago
  I particularly like Jim Meskinens stuff as an impressionist because you get the audio as well: https://m.youtube.com/watch?v=5rPKeUXjEvE https://m.youtube.com/watch?v=5rPKeUXjEvE
hombre_fatal 7y ago
The Gillian Anderson (Scully) replacement looks particularly good. The Youtube video only has Willem Dafoe in the title and I didn't even realize the woman was injected until I read the top Youtube comment. IMO it's the real star of the deepfake. Maybe because she doesn't have a fluorescent light above her nor is the camera constantly zoomed in on her face, so probably nicer scenario for the deepfake. Or maybe because they have all of X-Files to train the brain?
- pen2l 7y ago
  I think it definitely helps that Gillian Anderson actually looks like Jodie Foster. I kid you not, I for some years thought they were the one and same!
  - catalogia 7y ago
    I'm pretty sure Silence of the Lambs influenced the design and casting of the Dana Scully character. In both Silence of the Lambs and the X-Files pilot episode, you have young women with shoulder-length red hair starting their new job at the FBI investigating the death of women, including the examination of corpses (Dana Scully specializes in forensic pathology while the examination of corpses is more incidental to Clarice Starling's work, but is a very memorable scene in the movie.)
    - tofflos 7y ago
      From the article "...Anderson's most famous role, FBI agent Dana Scully on The X-Files, was directly inspired by Starling, according to The Truth Is Out There: The Official Guide to The X-Files...".
  - drdeadringer 7y ago
    Over the decades I have personally experienced several pairs of actors who "look the same" until I figured better. One early example of mine is Harrison Ford and Dennis Quaid [I was roughly 11 years old at the time].
- catalogia 7y ago
retreatguru 7y ago
When you see his face in profile near the end, it's clearly not Willem Dafoe's head shape. And in the middle his ear lobes were jumbled. But other than that it's pretty creepy! But that's probably because of the scene they chose :D
craze3 7y ago
What are some of the fastest and easiest tools for creating something like this myself ?
- shoeffner 7y ago
  You can try things such as: - https://github.com/joshua-wu/deepfakes_faceswap https://github.com/joshua-wu/deepfakes_faceswap - https://github.com/Oldpan/Faceswap-Deepfake-Pytorch https://github.com/Oldpan/Faceswap-Deepfake-Pytorch You might have to run on a frame by frame basis, e.g. using `ffmpeg -i file.mpg $filename%03d.bmp` [1] and stitching the results back together [2]. I haven't tried it, though, and there might be better alternatives. [1] https://stackoverflow.com/a/10962408 https://stackoverflow.com/a/10962408 [2] https://hamelot.io/visualization/using-ffmpeg-to-convert-a-set-of-images-into-a-video/ https://hamelot.io/visualization/using-ffmpeg-to-convert-a-s...
judge2020 7y ago
Here's another deepfake that looks really well done https://youtu.be/8OJnkJqkyio?t=11 https://youtu.be/8OJnkJqkyio?t=11
throwaway15392 7y ago
There’s going to be videos coming out in the next couple years that are going to shock the world and those recorded in the videos are going to claim they’re deep fakes which is why the media has been trying to make the public think deep fakes are easy to make
- throwaway122378 7y ago
  Starting with the desensitization now
- anigbrowl 7y ago
  They are though. It helps that I have a background in film and video but still.
jari_mustonen 7y ago
Pretty remarkable. Never the less... Faces convey the emotional content well but I think that in case of Dr. Lecter there is something missing. Maybe the look is not as intensively gleeful or something... The second strangeness is the background handling. The deep fakes are not handling the background near the face faces well. Maybe the different shape of faces forces the algorithm to generate the background and it's obviously not doing that part well. It gives sometimes the face the feel that is has been plastered on top of an image.
jamestimmins 7y ago
This is incredibly impressive. For a while I've wondered when it will be possible to "fork" movies and create different endings/scenes. I know that is a long way from this technology, but this kind of things gives me hope that will eventually be possible.
throwaway122378 7y ago
And guess who’s been producing them lately ... Hollywood. Makes me wonder who’s got some dirty videos that are gonna come out soon.
throwaway122378 7y ago
Visually the face looks real. There must be some code that can prove evidence of alerting?
deleted 7y ago
[deleted]
aaron695 7y ago
Could someone just make a deep fake technique that auto matches dubbing to the lip sync and make some $$$ and pushes foreign TV to everyone to help work towards world peace and create a real peak TV. It might not be possible but I'd like to see attempts.
Ataraxic 7y ago
The pupils are often not centered or circular for hannibal. Was actually a bit creepier at first because of it.
Seirdy 7y ago
I'm still waiting for a full release of Home Stallone, where every character is played by a deepfake of Sylvester Stallone except for Sylvester Stallone, who's played by Dwayne "The Rock" Johnson

87 points by laurex 7y ago

It's not really an improvement on many of the others out there. It has some of the same problems as well, such as oddly smooth skin tone, deformed or blurry ears, and the face looking like a morph with the original rather than completely different. It seems that some deep fake authors try to find faces similar to the original to make the deep fakes work.

01100011 7y ago

Direct link to youtube: https://www.youtube.com/watch?v=XJB5W2beVZ0 https://www.youtube.com/watch?v=XJB5W2beVZ0

signa11 7y ago
thanks ! the thing that ever so _slightly_ ruined it (for me atleast) were the eyes of the characters. they were just plain and utterly white without any blood-vessels. once i noticed that, it became kind of hard to ignore.

galago 7y ago

Its the original audio performances, and I think this shows how important the actors are. Test deep fakes only on image and I think they fall down a lot.

droopyEyelids 7y ago
When Dr Fakenstein drops a video, he does the voice AND the face. Really missing that, here.
e_proxus 7y ago
I particularly like Jim Meskinens stuff as an impressionist because you get the audio as well: https://m.youtube.com/watch?v=5rPKeUXjEvE https://m.youtube.com/watch?v=5rPKeUXjEvE

hombre_fatal 7y ago

The Gillian Anderson (Scully) replacement looks particularly good. The Youtube video only has Willem Dafoe in the title and I didn't even realize the woman was injected until I read the top Youtube comment. IMO it's the real star of the deepfake. Maybe because she doesn't have a fluorescent light above her nor is the camera constantly zoomed in on her face, so probably nicer scenario for the deepfake. Or maybe because they have all of X-Files to train the brain?

pen2l 7y ago
I think it definitely helps that Gillian Anderson actually looks like Jodie Foster. I kid you not, I for some years thought they were the one and same!
- catalogia 7y ago
  I'm pretty sure Silence of the Lambs influenced the design and casting of the Dana Scully character. In both Silence of the Lambs and the X-Files pilot episode, you have young women with shoulder-length red hair starting their new job at the FBI investigating the death of women, including the examination of corpses (Dana Scully specializes in forensic pathology while the examination of corpses is more incidental to Clarice Starling's work, but is a very memorable scene in the movie.)
  - tofflos 7y ago
    From the article "...Anderson's most famous role, FBI agent Dana Scully on The X-Files, was directly inspired by Starling, according to The Truth Is Out There: The Official Guide to The X-Files...".
- drdeadringer 7y ago
  Over the decades I have personally experienced several pairs of actors who "look the same" until I figured better. One early example of mine is Harrison Ford and Dennis Quaid [I was roughly 11 years old at the time].
catalogia 7y ago

retreatguru 7y ago

When you see his face in profile near the end, it's clearly not Willem Dafoe's head shape. And in the middle his ear lobes were jumbled. But other than that it's pretty creepy! But that's probably because of the scene they chose :D

craze3 7y ago

What are some of the fastest and easiest tools for creating something like this myself ?

shoeffner 7y ago
You can try things such as: - https://github.com/joshua-wu/deepfakes_faceswap https://github.com/joshua-wu/deepfakes_faceswap - https://github.com/Oldpan/Faceswap-Deepfake-Pytorch https://github.com/Oldpan/Faceswap-Deepfake-Pytorch You might have to run on a frame by frame basis, e.g. using `ffmpeg -i file.mpg $filename%03d.bmp` [1] and stitching the results back together [2]. I haven't tried it, though, and there might be better alternatives. [1] https://stackoverflow.com/a/10962408 https://stackoverflow.com/a/10962408 [2] https://hamelot.io/visualization/using-ffmpeg-to-convert-a-set-of-images-into-a-video/ https://hamelot.io/visualization/using-ffmpeg-to-convert-a-s...

judge2020 7y ago

Here's another deepfake that looks really well done https://youtu.be/8OJnkJqkyio?t=11 https://youtu.be/8OJnkJqkyio?t=11

throwaway15392 7y ago

There’s going to be videos coming out in the next couple years that are going to shock the world and those recorded in the videos are going to claim they’re deep fakes which is why the media has been trying to make the public think deep fakes are easy to make

throwaway122378 7y ago
Starting with the desensitization now
anigbrowl 7y ago
They are though. It helps that I have a background in film and video but still.

jari_mustonen 7y ago

Pretty remarkable. Never the less... Faces convey the emotional content well but I think that in case of Dr. Lecter there is something missing. Maybe the look is not as intensively gleeful or something... The second strangeness is the background handling. The deep fakes are not handling the background near the face faces well. Maybe the different shape of faces forces the algorithm to generate the background and it's obviously not doing that part well. It gives sometimes the face the feel that is has been plastered on top of an image.

jamestimmins 7y ago

This is incredibly impressive. For a while I've wondered when it will be possible to "fork" movies and create different endings/scenes. I know that is a long way from this technology, but this kind of things gives me hope that will eventually be possible.

throwaway122378 7y ago

And guess who’s been producing them lately ... Hollywood. Makes me wonder who’s got some dirty videos that are gonna come out soon.

throwaway122378 7y ago

Visually the face looks real. There must be some code that can prove evidence of alerting?

deleted 7y ago

[deleted]

aaron695 7y ago

Could someone just make a deep fake technique that auto matches dubbing to the lip sync and make some $$$ and pushes foreign TV to everyone to help work towards world peace and create a real peak TV. It might not be possible but I'd like to see attempts.

Ataraxic 7y ago

The pupils are often not centered or circular for hannibal. Was actually a bit creepier at first because of it.

Seirdy 7y ago

I'm still waiting for a full release of Home Stallone, where every character is played by a deepfake of Sylvester Stallone except for Sylvester Stallone, who's played by Dwayne "The Rock" Johnson