7 ms·
As AI porn generators get better, the stakes get higher
- deleted 3y ago[deleted]
- rcoveson 3y agoCan we please just skip to 2-5 years from now when image/video generation is so good that it's as easy to fake it as it is to lie in textual form? Most important information is textual, and there's really nothing at all that binds text to reality. So we have laws about fraud and libel for important matters. Trust is a hard problem! But we're working on it, and images were never much of a solution to it anyway. Most of the time, we just don't care. Many stories are untrue; explicitly fictional. Some of them are untrue in ways that could emotionally damage others (gossip, insults). That's just a part of social life, to be mitigated socially, not judicially. Images are going to be just like text. Let's all just embrace that already. You can't lie any more or less with them than you can text, once we all (inevitably) stop trusting them as though they were difficult to fabricate. There's a little turmoil coming, but there's less if we all just decide to get over it now rather than cling desperately to the idea that images are somehow more deeply intertwined with the real world than text is.
- enumjorge 3y agoI get what you're saying, and I do think we should start preparing for a future where images are not something we can trust because I think we'll inevitably get there, but images are different than text. They are information dense and can elicit an emotional reaction much faster than text can. Think of the fake images that showed Trump being violently arrested. Something like that can become viral much more easily than text. As for a world where we all learn to distrust images, I don't think we will fully get there. You still have people falling for email scams that by now are very clearly documented. Even a small percentage of people who are living in a different reality can be problematic for the rest of us.
- mitthrowaway2 3y agoA photo of Trump being violently arrested provokes a reaction because we assume it captures a real scene. A painting or a political cartoon showing the same scene would not, even if it were quite realistically painted. Before the camera was invented, paintings and engravings like that were the best anyone could do to transmit a scene, and now that AI can generate fake photorealistic images, photos will gradually have to be seen the same as a skilled painting. It might capture reality, or it might not.
- majormajor 3y agoTrends that will mitigate harassment done with stuff like this are already underway, but they're mostly ones that run contrary to the original spirit of the internet: * don't accept unsolicited messages or images from people you don't already know * don't leave your corporate-moderated walled garden of choice to search for stuff on the open internet * don't put too trust much into any information distributed primarily online I think these things will all be necessary but they are far more dystopian than the internet that I once hoped for.
- dtech 3y agoI wonder how much of that is innate and how much of that is because we're not used to fake pictures on a scale AI will allow yet
- anigbrowl 3y agoMost of it is innate. We've known photos can be faked for a long time, it was a lesson in my history textbook in high school. We've known that anyone could fake a photo using a computer for a long time too, image editing software got good in the 1990s. And so on. Rationally, we know all this. But biologically, we're wired to react first and think later; our reactions often shape our behavior more than logic. That's one reason that advertising and propaganda work; repetition trumps rationality. Add in the fact that large numbers of people are gullible fools who can be trained to uncritically repeat and spread untruths that appeal to confirmation bias.
- 3y ago
- tennisflyi 3y agoPretty sure those 2-5 years will never be realized due to Zeno’s paradox.
- IanCal 3y ago> Images are going to be just like text. Let's all just embrace that already. You can't lie any more or less with them than you can text, once we all (inevitably) stop trusting them as though they were difficult to fabricate People trust text and that's clearly written by someone not a snapshot of reality. There's a reason libel is a thing.
- deleted 3y ago[deleted]
- zb3 3y agoI don't see a problem with them. Can't we focus on more important (I mean actual) problems?
- hennell 3y agoThere are actual problems, they're mentioned in the article. Just because it doesn't affect you, doesn't mean it's not a problem or important to others.
- majormajor 3y agoLet's say your boss, or spouse, received fake photorealistic pornographic images of you with your boss's spouse... Why are you expressing annoyance about people focusing on the "unimportant" problem of than dealing with the fallout of "AI fake porn generators" than about other people causing these problems in the first place by focusing on the problem of generating faked porn. There's no real importance to generating this stuff.
- jcadam 3y agoThat's it, I'm getting a UUID tattooed onto my backside.
- majormajor 3y agoWell, you gotta show you had it at the time of the claimed recording, so... time for Google to release a new product for high-res date-authenticated scans of our whole bodies? ;)
- jcadam 3y agoLOL. "We regret to inform you that our entire database of full body scans was accessed and downloaded by unauthorized persons. We're providing you with a free year of online reputation repair services. We apologize for any inconvenience."
- Enginerrrd 3y ago
- mc32 3y agoIf this obviates the need for the exploitative sex video industry so be it. The sooner it’s relegated to history the better. If people never the less want to be exhibitionists and do it, that’s fine. Now, what’s true for real life should be true for synthetic productions. Depictions in real life that would be illegal should remain illegal in the synthetic world. Though I wonder if Japan will insist on pixelation of the groin.
- throwaway77897 3y ago> Depictions in real life that would be illegal should remain illegal in the synthetic world. Why? How is it any of your/our business what porn people generate and masturbate to in private?
- tetrep 3y ago> Depictions in real life that would be illegal should remain illegal in the synthetic world. I think creative works would be severely limited if nothing illegal could be depicted within them. If you're arguing only pornographic content should carry this restriction, I'd be interested as to why the same crime depicted in a non-pornographic film is better (in the sense that you think it should be allowed / not made illegal) than the same crime depicted in a pornographic film. Even restricted to only pornography, I don't see why I (as a hypothetical creative) should not be allowed to include a description of something illegal within the context of a pornographic film. i.e. I think it should be (legally speaking) fine for me to make a hot a steamy porno that also includes, as a core part of the porno, a scathing critique of my local town's property tax implementation while a bank robbery is ongoing. If it matters, let's say the main characters / people having sex are also doing the bank robbing. If you're trying to restrict what crimes are illegal to depict (rather than all crimes), then I'm not sure what metric you're using for that. Is it only explicitly sexual crimes that should not be in sexual films? Because there's plenty of crimes that are not intrinsicly sexual but that can be sexual because of the observer, e.g. Masochists can be aroused by illegal non-sexual physical abuse, would it be okay to have that illegal non-sexual physical abuse in an otherwise explicitly sexual pornographic film? If you're concerned about people "getting off" to crimes, I don't think your restrictions are going to mitigate that at all. People are aroused by the abuse in Uncle Tom's Cabin[0]. If you're trying to prevent people from being aroused by "bad" things, I don't think you'll see much success. Hell is other people, after all. [0]: I'm reading "The Masochistic Pleasures of Sentimental Literature" by Marianne Noble and it references a letter that's relevant here: "Even in my early childhood I loved to revel in ideas about the absolute master of one man over others. The thought of slavery had something exciting in it for me, alike whether from the standpoint of master or servant. That one man could possess, sell or whip another caused me intense excitement; and in reading 'Uncle Tom's Cabin' (which I read at about the beginning of puberty) I had erections." Same letter, different reference, is quoted on page 65 here of "The Erotics of History" by Donald L. Donham: https://www.jstor.org/stable/10.1525/j.ctt2204r8x.12 https://www.jstor.org/stable/10.1525/j.ctt2204r8x.12
- Animats 3y agoPornhub has an AI R&D operation. So far, they've mostly been restoring really old porno films from 1900-1920. Presumably they have work underway on generating content directly. As they point out, they have plenty of training data.
- hef19898 3y agoIt is always amazing how much technological impact the porn industry has. Media standards, streaming, filming, you name it. But then one of the first large internet use cases was porn.
- 130e13a 3y agoit still is one of the largest internet use cases today, iirc ~30% of all web traffic is porn.
- Jeff_Brown 3y agoOne of the first uses of film, too. In fact one of the earliest uses of writing -- mosr Egyptian writing fragments are either receipts or (text) porn.
- pessimizer 3y agoAs far as I can tell, the only thing in danger is employment in the porn industry. The only porn stars left will be the ones that are really just like any other eCeleb living from panhandling from the parasocial. The "deepfake" armageddon that's been blathered on and on about is obviously horseshit. If people can make a deepfake of anybody in five minutes, nobody is going to get fired (without getting the shit sued out of them) for deepfakes of them showing up. Also no one is going to believe in the pictures, even if they are real. This is a blessing to the future victims of revenge porn, one that people whose photographs were spread around before the dawn of generative AI won't be treated to. This has always been a media panic to lay the groundwork for more censorship and more surveillance. We'll have to be licensed to run an algorithm if they have anything to do with it, and our models will require a Microsoft signing key.
- resolutebat 3y agoThe friendly article describes a case where a small-town school teacher was, in fact, fired because of deepfaked images.
- CamperBob2 3y agoAnd now imagine a world where deepfake porn is ubiquitous. Does the teacher still get fired?
- wmf 3y agoYes actually, because the decisions are made by old people who don't learn.
- smegger001 3y agothen the next day a new deepfake porn shows up of the people who had them fired sleeping with the person they fired
- CamperBob2 3y agoIf people can make a deepfake of anybody in five minutes, nobody is going to get fired (without getting the shit sued out of them) for deepfakes of them showing up. Exactly. At some point people will just stop caring, which is the best of all possible outcomes.
- seydor 3y agoThis is great cause soon nobody will believe any image is real.
- krapp 3y agoWhy do people keep saying this? People believe far less convincing things now. People see After Effects flares and badly animated CGI on Youtube and photoshopped images and think aliens are real and cities appear in the skies over China. People will believe whatever confirms their biases, regardless of its quality. I don't think this is going to change much, one way or the other.
- anigbrowl 3y agoTo cope with their discomfort at not having a good answer for any of the potential problems. Also, reflexive denial is a very common tactic for avoiding responsibility. In an increasingly networked world, people can rely on others with the same personality type to back up their denials.
- pessimizer 3y agoThe only real problem is the problem of proof. People won't believe real images when deepfakes are common. How are you going to prove what you say is true? How are you going to convince people to act on what would be impossible to verify? Not only is is a bigger problem than a bit of puritanism, but it's one that doesn't completely solve itself.
- pessimizer 3y ago> Why do people keep saying this? Because there's no reasonable argument against it. What I want to understand is why people have such a low opinion of the intelligence of the people around them. I can't imagine a person so stupid that they would be aware that they can make a 1-click deepfake, but also be totally convinced by every photo they see. This would be somebody who runs away screaming when they see a train coming towards them on television (which people actually did at the dawn of film, but they got used to the new situation.) > People believe far less convincing things now. People see After Effects flares and badly animated CGI on Youtube and photoshopped images and think aliens are real and cities appear in the skies over China. People will believe whatever confirms their biases, regardless of its quality. People believe it because it is harder to do now. They use a very sensible heuristic (often badly) that nobody would go through the trouble to fake X images for Y reason. The question is explicitly about what happens when you don't have to go through any trouble to create convincing fake images.
- joshstrange 3y ago> A Washington Post piece recounts how a small-town school teacher lost her job after students’ parents learned about AI porn made in the teacher’s likeness without her consent. Just a few months ago, a 22-year-old was sentenced to six months in jail for taking underage womens’ photos from social media and using them to create sexually explicit deepfakes. Following the link [0]: > People viewing explicit images of you without your consent — whether those images are real or fake — is a form of sexual violence, said Kristen Zaleski, director of forensic mental health at Keck Human Rights Clinic at the University of Southern California. Victims are often met with judgment and confusion from their employers and communities, she said. For example, Zaleski said she’s already worked with a small-town schoolteacher who lost her job after parents learned about AI porn made in the teacher’s likeness without her consent. > “The parents at the school didn’t understand how that could be possible,” Zaleski said. “They insisted they didn’t want their kids taught by her anymore.” Holy shit that's fucked up. It wouldn't be right but I'd be hard pressed not to create deep-fakes of the people who fired me and/or the parents to show them how bullshit it is if I was fired for something I had no connection to and was actually the victim of. [0] https://www.washingtonpost.com/technology/2023/02/13/ai-porn-deepfakes-women-consent/ https://www.washingtonpost.com/technology/2023/02/13/ai-porn...
- wmf 3y agoSeems like a clear case of wrongful termination.
- masklinn 3y agoAt will employment being the law of the land, the only way to actually get a case of wrongful termination is to document that you’re firing the person for one of the few reasons which are unlawful (race, religion, sex, origin, disability, medical condition, or age, as well as additional restrictions the state may have in place). “The parents are complaining and we’re chickenshits” is almost certainly not an unlawful reason, if they even bother justifying the dismissal (which most employers don’t).
- michaelt 3y ago
- bottlepalm 3y agoI could say AI is going to wreck porn in that you can't compete with on demand pics/vids/VR of any fantasy you want.. but it's really going to be the least of our problems.
- igetspam 3y agoThe internet wrecked pornography. It's become a game of extremes. There are studies that indicate that kids today think the violence depicted in what we used to call "hardcore" is what's normal and expected. Both boys and girls think this and young women are suffering through humiliation and abuse instead of thinking that sex should be a mutually pleasurable act. AI is just going to make it worse and more extreme but it's already wrecked.
- bottlepalm 3y agoI meant the business, but yea that too. Brave new world.
- bloopernova 3y agoPornpen.ai unfortunately generates images based on user prompts. So everything is ridiculous anime proportions.
- GaggiX 3y agoI don't know why the article talks mostly about unstable diffusion, when looking at the most popular models on CivitAI it is clear that there are even better models for porn, making it clear that you don't need to raise $26,000 to make a good model, especially if the effort is distributed, users will train models, the best ones will be further merged and trained, literally the evolutionary process.
- majormajor 3y agoThere's a lot of head-in-the-sand here about "soon people will know better than believe images" which fails to realistically engage with the world in a couple of ways: 1) ignoring a problem and harms because "soon" we think such tricks may not work as well is a disservice to anyone unlucky enough to be harmed now 2) Photoshop and similar have been around for a long time now yet fake images and videos still often fool people on first glance, so it's a bit blindly optimistic to assume that in the future volume alone will change people's initial credulity EDIT: elsewhere on HN today there was a link to an annonymous post on Blind claiming to be a Google employee on a PIP because of some sort of quota imposed on their manager. This may be true, it may not be. I don't have a way of judging personally, and obviously text on the internet has been full of bullshit for a long time. But is anyone here confident enough to claim that nobody who encountered that on HN or Blind would believe it as a result?
- canadianwriter 3y agoI always bring this back to photoshopping. It's been around forever. That teacher in the article - what if she was photoshopped instead of "deep faked" would anything have been different? Photoshopping has been around forever. Just a bit weird to me that people are predicting the AI end of the world with this stuff when its really just a slightly faster way to do something we've had for ages.
- flangola7 3y agoPhotoshop doesn't create photorealistic live video of you. Even voices can be matched. "Slightly" faster is vastly underselling it, deepfakes can be rendered in real time now. The same tech powers TikTok filters.
- jrflowers 3y agoI love the people pointing out a theoretical future wherein deepfakes are so prevalent that only a rube would fall for them. I can’t imagine reading “22 year old teacher gets fired for no fault of her own” and immediately writing up an explanation as to why nobody should be able to get in trouble for making and distributing deepfake porn of strangers in the future, but I am not so enlightened.
- majkinetor 3y agoUnless picture of me is signed by my private key, its fake. Simple as that.
- Tao3300 3y ago> A deepfaked, gender-swapped image of Donald Trump, created with Unstable Diffusion Here's the real scandal: techcrunch didn't blur out the nipples!
- igetspam 3y agoI'm not good with generative AI. I always make acid trip soup. Is there a version of this where I can drop photos of my face and have it generate variations of me? Preferably a SFW version because I'm more curious about the level of difficulty in generation than becoming internet trash.
- ekanawangsa 3y ago[flagged]
- yoyoausiis 3y ago[dead]
- yoyoausiis 3y ago[dead]
- hhonggg 3y ago[dead]