4 ms·

We Are Truly Fucked: Everyone Is Making AI-Generated Fake Porn Now

35 points by nz 9y ago

tbirrell 9y ago
This is probably NSFW and should be flagged as such. While it is a technical subject (the video "photoshopping" technology) the examples used render the article difficult to view at work. Especially if company firewalls are doing text searches for keywords.
- krapp 9y ago
  People shouldn't be surfing Hacker News at work anyway, and the title should make the nature of the content obvious.
  - chrisbennet 9y ago
    Back to work you slackers! Who said you could surf the Internets while you eat lunch at your desk!!!
Everlag 9y ago
If you're looking for a quicker summary of what's happening, there's a write up on r/cyberpunk[0] that was posted 3 days ago. There's a very specific flavor to the subreddit and the comments on that write up that might be satisfying for those that appreciate cyberpunk. If it wasn't immediately evident, this is very NSFW. [0] https://www.reddit.com/r/Cyberpunk/comments/7sexm6/ https://www.reddit.com/r/Cyberpunk/comments/7sexm6/
- propman 9y ago
  Wow I just went through this and the deepfakes subreddit, this has SERIOUS case of abuse all over it. How soon till high school kids bully peers over this? Or even teachers? Blackmail, revengeporn, bullying, harassment. I'm a bit shocked right now at how real it is. I saw one link that was almost undetectable even with very complicated movements. We need some regulations over this as soon as possible to prevent abuse.
  - commandlinefan 9y ago
    Actually I was thinking it would do exactly the opposite - even if a legitimate tape is leaked, now the victim can say, "that's fake" and it will be completely believable.
    - mcphage 9y ago
      > now the victim can say, "that's fake" and it will be completely believable Believable, perhaps—but no less humiliating.
    - vaygr 9y ago
      Or not the victim. Combine it with the girl with the dragon tattoo story, and it may become scary how helpless the victim could be under difficult circumstances with no piece of real evidence aka auto-marked as fake.
  - Panoramix 9y ago
    When it becomes trivial to generate convincing fake videos, nobody will take said videos seriously. The real issue will be in politics, misinformation, etc. And I think it's coming (if we're not already there) and it's almost unstoppable. We'll bee in a situation described by Iain M. Banks and similar sci-fi authors, and we will need similar solutions (i.e, only accept as true videos that are "certified" in some way, preferably by multiple reliable institutions).
    - krapp 9y ago
      > When it becomes trivial to generate convincing fake videos, nobody will take said videos seriously. People often weigh evidence based on what interpretation confirms and reinforces their existing biases - there is plenty of unconvincing, obviously fake video out there of conspiratorial and paranormal activity that people nonetheless take seriously. In a court of law, sure, the value of video evidence will be diminished, but in the court of public opinion, when these videos are indistinguishable from reality, not explicitly labelled and the subjects have the weight of political, social or religious prejudice against them? Probably not so much.
hungerstrike 9y ago
They didn't show or even mention the highest quality fakes of huge celebrities that have been seen on /r/deepfakes like Katy Perry or Scarlett Johansson. I wonder why? I thought those names were way bigger than Daisy Ridley or Jessica Alba.
benmarks 9y ago
I fear a future in which recorded evidence of misconduct cast a shadow of doubt of equal size.
- Animats 9y ago
  Yes. Surveillance video now has far less value as evidence. Especially if cops had access to the chain of custody.
- kowdermeister 9y ago
  It just means that image forensics will be a much more profitable business in the future than we probably thought it before. + don't forget that if the source "vehicle" video is found, then it's a proof against who filed it, so it might not worth the risk.
  - kls 9y ago
    I was thinking the same thing, at least in the US it will expand the shadow of a doubt, as any doctoring could lead to inadmissible evidence.
tlb 9y ago
Someone should build the app that replaces one actor's face with the viewer's own face, rather than a celebrity. It could 3D-scan the viewer and automatically find videos with sufficiently similar actor bodies. Then you could watch yourself interacting with the other actors. Depending on the personality of the viewer, it would be either the best or worst thing they'd ever seen.
breakingcups 9y ago
I can't wait for the damning Donald Trump video to finally come out only to now be loudly rejected by him and his followers as fake news because "anyone can do it with an app!"
88e282102ae2e5b 9y ago
Maybe this could finally bring the use of cryptographic signatures into the mainstream. An additional incentive might be that they could even be used to "cheat" when unfavorable news came out: an organization that routinely signs all of their press statements and internal documents could disavow any unsigned leaks, perhaps.

35 points by nz 9y ago

This is probably NSFW and should be flagged as such. While it is a technical subject (the video "photoshopping" technology) the examples used render the article difficult to view at work. Especially if company firewalls are doing text searches for keywords.

krapp 9y ago
People shouldn't be surfing Hacker News at work anyway, and the title should make the nature of the content obvious.
- chrisbennet 9y ago
  Back to work you slackers! Who said you could surf the Internets while you eat lunch at your desk!!!

Everlag 9y ago

If you're looking for a quicker summary of what's happening, there's a write up on r/cyberpunk[0] that was posted 3 days ago. There's a very specific flavor to the subreddit and the comments on that write up that might be satisfying for those that appreciate cyberpunk. If it wasn't immediately evident, this is very NSFW. [0] https://www.reddit.com/r/Cyberpunk/comments/7sexm6/ https://www.reddit.com/r/Cyberpunk/comments/7sexm6/

propman 9y ago
Wow I just went through this and the deepfakes subreddit, this has SERIOUS case of abuse all over it. How soon till high school kids bully peers over this? Or even teachers? Blackmail, revengeporn, bullying, harassment. I'm a bit shocked right now at how real it is. I saw one link that was almost undetectable even with very complicated movements. We need some regulations over this as soon as possible to prevent abuse.
- commandlinefan 9y ago
  Actually I was thinking it would do exactly the opposite - even if a legitimate tape is leaked, now the victim can say, "that's fake" and it will be completely believable.
  - mcphage 9y ago
    > now the victim can say, "that's fake" and it will be completely believable Believable, perhaps—but no less humiliating.
  - vaygr 9y ago
    Or not the victim. Combine it with the girl with the dragon tattoo story, and it may become scary how helpless the victim could be under difficult circumstances with no piece of real evidence aka auto-marked as fake.
- Panoramix 9y ago
  When it becomes trivial to generate convincing fake videos, nobody will take said videos seriously. The real issue will be in politics, misinformation, etc. And I think it's coming (if we're not already there) and it's almost unstoppable. We'll bee in a situation described by Iain M. Banks and similar sci-fi authors, and we will need similar solutions (i.e, only accept as true videos that are "certified" in some way, preferably by multiple reliable institutions).
  - krapp 9y ago
    > When it becomes trivial to generate convincing fake videos, nobody will take said videos seriously. People often weigh evidence based on what interpretation confirms and reinforces their existing biases - there is plenty of unconvincing, obviously fake video out there of conspiratorial and paranormal activity that people nonetheless take seriously. In a court of law, sure, the value of video evidence will be diminished, but in the court of public opinion, when these videos are indistinguishable from reality, not explicitly labelled and the subjects have the weight of political, social or religious prejudice against them? Probably not so much.

hungerstrike 9y ago

They didn't show or even mention the highest quality fakes of huge celebrities that have been seen on /r/deepfakes like Katy Perry or Scarlett Johansson. I wonder why? I thought those names were way bigger than Daisy Ridley or Jessica Alba.

benmarks 9y ago

I fear a future in which recorded evidence of misconduct cast a shadow of doubt of equal size.

Animats 9y ago
Yes. Surveillance video now has far less value as evidence. Especially if cops had access to the chain of custody.
kowdermeister 9y ago
It just means that image forensics will be a much more profitable business in the future than we probably thought it before. + don't forget that if the source "vehicle" video is found, then it's a proof against who filed it, so it might not worth the risk.
- kls 9y ago
  I was thinking the same thing, at least in the US it will expand the shadow of a doubt, as any doctoring could lead to inadmissible evidence.

tlb 9y ago

Someone should build the app that replaces one actor's face with the viewer's own face, rather than a celebrity. It could 3D-scan the viewer and automatically find videos with sufficiently similar actor bodies. Then you could watch yourself interacting with the other actors. Depending on the personality of the viewer, it would be either the best or worst thing they'd ever seen.

breakingcups 9y ago

I can't wait for the damning Donald Trump video to finally come out only to now be loudly rejected by him and his followers as fake news because "anyone can do it with an app!"

88e282102ae2e5b 9y ago

Maybe this could finally bring the use of cryptographic signatures into the mainstream. An additional incentive might be that they could even be used to "cheat" when unfavorable news came out: an organization that routinely signs all of their press statements and internal documents could disavow any unsigned leaks, perhaps.