8 ms·

> We assume, too, that face swapping is the end game, but it’s clearly just the beginning. Isn't the end game an endless stream of personalized content for eve

> We assume, too, that face swapping is the end game, but it’s clearly just the beginning. Isn't the end game an endless stream of personalized content for everyone? Wherein the entire corpus of human-created media becomes a training set for our fantasies. It is interesting how entertainment is again pushing the boundary of technology. Soon enough this push to make face editing tools for porn more accessible to everyone will allow anyone to: 1) Replace their ex-husband's face in their old family videos with their new husband's face. 2) Create a viral video of Donald Trump murdering someone. 3) Be the star of their favourite movie, porn or otherwise. (What's the effect this would have on people's memories, when they actively see themselves doing everything James Bond does, for instance? Shooting people, being generally powerful, and "getting the girl"?)

deleted 9y ago
[deleted]
opportune 9y ago
The technology for all of these exists, it's just a matter of motivation. see: https://www.youtube.com/watch?v=ttGUiwfTYvg https://www.youtube.com/watch?v=ttGUiwfTYvg
IntronExon 9y ago
Things are going to get very weird in porn, when you don’t have convince a human to actually do it. I have to assume that early adopters will also be people with predilections which are unserved, or illegal. If people worry about their kids seeing disturbing porn now, imagine when it’s AI generated, photorealistic rape, snuff, child porn. Illegal or not, if it’s purely virtual law enforcement is going to focus on the subset of crimes which involve actual human victims.
- hndamien 9y ago
  Will they really? There are already several thought crimes.
- jstarfish 9y ago
  > imagine when it’s AI generated, photorealistic rape, snuff, child porn. Illegal or not, if it’s purely virtual law enforcement is going to focus on the subset of crimes which involve actual human victims. In the US, all of that is already illegal. If you put yourself in a position where what you possess is indistinguishable from the real thing, the courts err on the side of the potential victim. Law enforcement's priorities are not going to change; they don't distinguish between what's virtual or not. If it looks like CP, you can't point to a producer with valid 2257 documentation and it isn't obviously a cartoon, you're cooked.
  - jpatokal 9y ago
    How does "possession" work when everything's in the cloud and instantly accessible to anyone?
    - jstarfish 9y ago
      If it's in your Dropbox, it's presumed to be yours. If you upload it to reddit, congratulations, you're no longer a consumer. You're a distributor. New charges apply. If you just browse, you're sort of safe, but you better hope your browser isn't caching anything to disk. Forensic reconstruction still constitutes possession. But nobody just browses.
      - djsumdog 9y ago
        You're not "sort of safe" if you browse. The US has ISP reporting laws, as does Australia, South Africa, France and others: http://chartsbin.com/view/q4y http://chartsbin.com/view/q4y It's a weird situation because in the UK, they simply block the content (no freedom of speech). In the US, we have freedom of speech so ISPs can't block anything. But they do have to report if you visit a site that contains illegal material or transmit it, plain text, through their services. Child pornography is a strict liability crime to, so intent doesn't matter. Say you download something from /r/gonewild and the girl is 16, but she looks 20 to you. Too bad. You're not in violation of the law and can be put on a sex offender list. Many people probably have illegal content without even realizing it. That's another reason why encrypting all your devices is so important.
- DanBC 9y ago
  >Illegal or not, if it’s purely virtual law enforcement is going to focus on the subset of crimes which involve actual human victims. I'm not convinced. https://en.wikipedia.org/wiki/United_States_v._Handley https://en.wikipedia.org/wiki/United_States_v._Handley
- dragonwriter 9y ago
  > If people worry about their kids seeing disturbing porn now, imagine when it’s AI generated, photorealistic rape, snuff, child porn. There was a time when it was quite easy to find (without even trying for that specific content) photorealistic rape, snuff, bestiality, and child porn on the public web, without any AI involved. > Illegal or not, if it’s purely virtual law enforcement is going to focus on the subset of crimes which involve actual human victims. Actual prosecutions for virtual (generally not photorealistic) child porn in various jurisdictions demonstrate that this is not a hard and fast rule.
  - djsumdog 9y ago
    Animations or fiction of obscene content are not illegal in the US and Japan. They are illegal in the UK (a man was sentenced for Simpsons's porn) and many other countries. Now with added realism, these lines could become blurry and we could see some of these issues brought up again.
    - jstarfish 9y ago
      > Animations or fiction of obscene content are not illegal in the US Citation please. There is nowhere near enough precedent to draw such a conclusion in the US. The defendants in these cases often end up pleading guilty. US v Hanley, US v Red Rose Stories, etc.
      - djsumdog 9y ago
        Hmm .. seems things have changed quite a bit since I last read up on this. It seems to vary by state: https://en.wikipedia.org/wiki/Legal_status_of_drawn_pornography_depicting_minors#United_States https://en.wikipedia.org/wiki/Legal_status_of_drawn_pornogra...
  - sushid 9y ago
    But the legal reasoning right now that the children are harmed in the making of it and their victims, dead or not, suffered through the making and suffers through continued distribution of it. I'm sure there'll be some landmark cases soon enough.
- scandox 9y ago
  I think this progression will do no more than force an existing moral question into the open. What is the moral quality of a thought? Personally I believe that even unspoken thoughts can have a strong moral dimension for the individual, though of course I see no legal dimension. One aspect of this will be does our indulgence of our own negative fantasies weaken our capability to act rightly when presented with a real world moral choice and does that make us culpable...or more culpable if we make a wrong choice.
  - neveroffensive 9y ago
    > One aspect of this will be does our indulgence of our own negative fantasies weaken our capability to act rightly when presented with a real world moral choice and does that make us culpable...or more culpable if we make a wrong choice. It'll be really interesting to see more data come out about this. This concept is pretty much at the core of the video game violence debate which is still somewhat ongoing.
    - deleted 9y ago
      [deleted]
    - intended 9y ago
      It depend - if it’s executive decision making many hours after playing an immersive game - people figure out what’s fantasy and what is not. I suspect that if it’s 2 seconds after pulling off a VR headset after being in a photorealistic world which had no forced errors then people would be very confused.
psyc 9y ago
Don't shoot the messenger, but here are a couple more techno-morality scenarios: * A browser extension that detects if the social media profile you're viewing face-matches any revenge-porn that's out there, and serves it to you * A phone app that undresses people, or [woman < AGE], or whoever, in real-time via AI-guided compositing. Will this be considered as offensive as putting a mirror on your shoe? * Digital VR girl/boy-friends ala the movie "Her", except with the face, body, and voice of anyone you choose Suddenly all these things seem very close at hand.
- Y_Y 9y ago
  I think it'd probably be safer putting a _lower_ limit on the age for your undressing app.
  - deleted 9y ago
    [deleted]
  - stuntkite 9y ago
    Yeah, because the people that are going to be virtually undressing minors are going to be stopped by DRM. I mean seriously the world is about to get a lot weirder. These tools aren't even hard to use currently with little to no programming experience. Sure it's tough to get good results but that's going to change quick. How we adjust as a planet and society is going to be a real growth experience ... or utter chaos. Maybe both?
- Swizec 9y ago
  I think we’re going to come to consider these things normal and mundane. Anyone can see you fake naked at any time. Meh who cares. Anyone can put you in any random video. Meh who cares. Anyone can ... meh We used to think it scandalous/offensive for someone to take photos of us. Now it’s just part of being outside. We don’t even think about the fact that everyone walka around with a camera.
  - neveroffensive 9y ago
    > meh I think this is going to be the real answer for how we can best handle changes like this. So what if people can see a highly accurate computer simulation of you naked, we do the same things in our heads half the time anyways. Aside from the taboo, is there anything really fundamentally wrong with nudity?
monksy 9y ago
> ex-husband's face in their old family videos with their new husband's face Calm down Charlie Brooker.
- willejs 9y ago
  Shut up Nathan Barley.
zodPod 9y ago
Number 3 is really exciting to me. Think about every movie making you the star of the action. That'd be insane!
- JetSpiegel 9y ago
  Play any blockbuster FPS from the last decades to get a taste of this "future".
  - zodPod 9y ago
    I really think it'd be more fun to watch it in some ways. Like in FPS I'm typically "anonymous guy" or "random name given by the creators". If it was me watching myself in some random movie I think it'd be pretty awesome.
petercooper 9y ago
Isn't the end game an endless stream of personalized content for everyone? We can keep going. Why would that be desirable? It hits the right chemical buttons in the brain. Drag it out far enough and we're really aiming at being blissed out brains in jars being fed shots of endorphins at the right intervals.
- ball_of_lint 9y ago
  https://questionablecontent.net/view.php?comic=3662 https://questionablecontent.net/view.php?comic=3662
- psyc 9y ago
  I think I'm partial to a variant of wireheading that sort of linearly shifts our perception of pain and pleasure. Getting an arm hacked off is like a bad headache, normal undesirable things are like a minor ache, normal day-to-day is like a fun night out, and orgasm is like ... I don't know, heroin I guess.
  - toomanybeersies 9y ago
    I don't know if the human brain could handle that. If you have too many fun nights out, they start to wear. If you take too many drugs, they start to lose the magic, they just become normal. You need the highs with the lows.
    - spondyl 9y ago
      I suppose if we got to that point, you could replace that portion of the brain with cybernetics, save the state before having taken any drugs then every so often, flash it back to the beginning?
      - Godel_unicode 9y ago
        If you haven't read Peter F Hamilton's Commonwealth saga, you might appreciate it. Memory editing plus effective immortality is an interesting concept.
toomanybeersies 9y ago
Speaking of the effect this would have on peoples memories, there's also the potential to use these tools to gaslight [1] someone. An abuser could make images where a person was at an event they were never at, or with a person they never met. > "You've totally met Steve before, here's a photo of you with him, how do you not remember?" An abuser could even more effectively tear down someones reality than ever before. If they were having an affair with someone they just met, they could claim to be old school friends catching up, just insert them into an old photo. Obviously, it's not all bad. There is the potential for this to be used for good as well, but I'm a pessimist. [1] https://en.wikipedia.org/wiki/Gaslighting https://en.wikipedia.org/wiki/Gaslighting
- Bartweiss 9y ago
  I mean, there's presumably a very short window for that before photo evidence becomes unconvincing to people. The first time a Senator gets "exposed" for some misdeed but proves the evidence is fake, "there's a photo of this" loses its punch. The surrealism of seeing a fake recreation of oneself might have some impact, but we handled ultra-realistic paintings alright. It does touch on an interesting point, though: we've had roughly 100 years in which photo and audio recreations of events constitute "hard evidence" beyond our ability to fully falsify. It appears that within the next ~20 years we'll lose that reliability - footage of a politician making a dirty deal or a businessman engaging in conspiracy will become deniable not just as a misleading edit, but as outright fabrication. What do we do at that point? Do smartphone videos get automatically hashed and uploaded to a blockchain somewhere, so that we can prove when the video came into being? Do we return to an 1850s sense of news, where claims effectively cease to be falsifiable except via personal experience? Are we ready for any of this?
  - ryacko 9y ago
    That's not really true. Maybe fifty years when cameras were of a sufficient quality that touchups would be noticed compared to a photorealistic painting.
    - Paraesthetic 9y ago
djsumdog 9y ago
If we really had the Holodeck from Star Trek TNG, one of the first five uses would most likely be porn and/or a brothel.
icc97 9y ago
People have been able to put celebrity faces on porn photos for decades. I don't see how this is significantly different. We could create a viral picture of Trump killing someone now.

deleted 9y ago

[deleted]

opportune 9y ago

The technology for all of these exists, it's just a matter of motivation. see: https://www.youtube.com/watch?v=ttGUiwfTYvg https://www.youtube.com/watch?v=ttGUiwfTYvg

IntronExon 9y ago

Things are going to get very weird in porn, when you don’t have convince a human to actually do it. I have to assume that early adopters will also be people with predilections which are unserved, or illegal. If people worry about their kids seeing disturbing porn now, imagine when it’s AI generated, photorealistic rape, snuff, child porn. Illegal or not, if it’s purely virtual law enforcement is going to focus on the subset of crimes which involve actual human victims.

hndamien 9y ago
Will they really? There are already several thought crimes.
jstarfish 9y ago
> imagine when it’s AI generated, photorealistic rape, snuff, child porn. Illegal or not, if it’s purely virtual law enforcement is going to focus on the subset of crimes which involve actual human victims. In the US, all of that is already illegal. If you put yourself in a position where what you possess is indistinguishable from the real thing, the courts err on the side of the potential victim. Law enforcement's priorities are not going to change; they don't distinguish between what's virtual or not. If it looks like CP, you can't point to a producer with valid 2257 documentation and it isn't obviously a cartoon, you're cooked.
- jpatokal 9y ago
  How does "possession" work when everything's in the cloud and instantly accessible to anyone?
  - jstarfish 9y ago
    If it's in your Dropbox, it's presumed to be yours. If you upload it to reddit, congratulations, you're no longer a consumer. You're a distributor. New charges apply. If you just browse, you're sort of safe, but you better hope your browser isn't caching anything to disk. Forensic reconstruction still constitutes possession. But nobody just browses.
    - djsumdog 9y ago
      You're not "sort of safe" if you browse. The US has ISP reporting laws, as does Australia, South Africa, France and others: http://chartsbin.com/view/q4y http://chartsbin.com/view/q4y It's a weird situation because in the UK, they simply block the content (no freedom of speech). In the US, we have freedom of speech so ISPs can't block anything. But they do have to report if you visit a site that contains illegal material or transmit it, plain text, through their services. Child pornography is a strict liability crime to, so intent doesn't matter. Say you download something from /r/gonewild and the girl is 16, but she looks 20 to you. Too bad. You're not in violation of the law and can be put on a sex offender list. Many people probably have illegal content without even realizing it. That's another reason why encrypting all your devices is so important.
DanBC 9y ago
>Illegal or not, if it’s purely virtual law enforcement is going to focus on the subset of crimes which involve actual human victims. I'm not convinced. https://en.wikipedia.org/wiki/United_States_v._Handley https://en.wikipedia.org/wiki/United_States_v._Handley
dragonwriter 9y ago
> If people worry about their kids seeing disturbing porn now, imagine when it’s AI generated, photorealistic rape, snuff, child porn. There was a time when it was quite easy to find (without even trying for that specific content) photorealistic rape, snuff, bestiality, and child porn on the public web, without any AI involved. > Illegal or not, if it’s purely virtual law enforcement is going to focus on the subset of crimes which involve actual human victims. Actual prosecutions for virtual (generally not photorealistic) child porn in various jurisdictions demonstrate that this is not a hard and fast rule.
- djsumdog 9y ago
  Animations or fiction of obscene content are not illegal in the US and Japan. They are illegal in the UK (a man was sentenced for Simpsons's porn) and many other countries. Now with added realism, these lines could become blurry and we could see some of these issues brought up again.
  - jstarfish 9y ago
    > Animations or fiction of obscene content are not illegal in the US Citation please. There is nowhere near enough precedent to draw such a conclusion in the US. The defendants in these cases often end up pleading guilty. US v Hanley, US v Red Rose Stories, etc.
    - djsumdog 9y ago
      Hmm .. seems things have changed quite a bit since I last read up on this. It seems to vary by state: https://en.wikipedia.org/wiki/Legal_status_of_drawn_pornography_depicting_minors#United_States https://en.wikipedia.org/wiki/Legal_status_of_drawn_pornogra...
- sushid 9y ago
  But the legal reasoning right now that the children are harmed in the making of it and their victims, dead or not, suffered through the making and suffers through continued distribution of it. I'm sure there'll be some landmark cases soon enough.
scandox 9y ago
I think this progression will do no more than force an existing moral question into the open. What is the moral quality of a thought? Personally I believe that even unspoken thoughts can have a strong moral dimension for the individual, though of course I see no legal dimension. One aspect of this will be does our indulgence of our own negative fantasies weaken our capability to act rightly when presented with a real world moral choice and does that make us culpable...or more culpable if we make a wrong choice.
- neveroffensive 9y ago
  > One aspect of this will be does our indulgence of our own negative fantasies weaken our capability to act rightly when presented with a real world moral choice and does that make us culpable...or more culpable if we make a wrong choice. It'll be really interesting to see more data come out about this. This concept is pretty much at the core of the video game violence debate which is still somewhat ongoing.
  - deleted 9y ago
    [deleted]
  - intended 9y ago
    It depend - if it’s executive decision making many hours after playing an immersive game - people figure out what’s fantasy and what is not. I suspect that if it’s 2 seconds after pulling off a VR headset after being in a photorealistic world which had no forced errors then people would be very confused.

psyc 9y ago

Don't shoot the messenger, but here are a couple more techno-morality scenarios: * A browser extension that detects if the social media profile you're viewing face-matches any revenge-porn that's out there, and serves it to you * A phone app that undresses people, or [woman < AGE], or whoever, in real-time via AI-guided compositing. Will this be considered as offensive as putting a mirror on your shoe? * Digital VR girl/boy-friends ala the movie "Her", except with the face, body, and voice of anyone you choose Suddenly all these things seem very close at hand.

Y_Y 9y ago
I think it'd probably be safer putting a _lower_ limit on the age for your undressing app.
- deleted 9y ago
  [deleted]
- stuntkite 9y ago
  Yeah, because the people that are going to be virtually undressing minors are going to be stopped by DRM. I mean seriously the world is about to get a lot weirder. These tools aren't even hard to use currently with little to no programming experience. Sure it's tough to get good results but that's going to change quick. How we adjust as a planet and society is going to be a real growth experience ... or utter chaos. Maybe both?
Swizec 9y ago
I think we’re going to come to consider these things normal and mundane. Anyone can see you fake naked at any time. Meh who cares. Anyone can put you in any random video. Meh who cares. Anyone can ... meh We used to think it scandalous/offensive for someone to take photos of us. Now it’s just part of being outside. We don’t even think about the fact that everyone walka around with a camera.
- neveroffensive 9y ago
  > meh I think this is going to be the real answer for how we can best handle changes like this. So what if people can see a highly accurate computer simulation of you naked, we do the same things in our heads half the time anyways. Aside from the taboo, is there anything really fundamentally wrong with nudity?

monksy 9y ago

> ex-husband's face in their old family videos with their new husband's face Calm down Charlie Brooker.

willejs 9y ago
Shut up Nathan Barley.

zodPod 9y ago

Number 3 is really exciting to me. Think about every movie making you the star of the action. That'd be insane!

JetSpiegel 9y ago
Play any blockbuster FPS from the last decades to get a taste of this "future".
- zodPod 9y ago
  I really think it'd be more fun to watch it in some ways. Like in FPS I'm typically "anonymous guy" or "random name given by the creators". If it was me watching myself in some random movie I think it'd be pretty awesome.

petercooper 9y ago

Isn't the end game an endless stream of personalized content for everyone? We can keep going. Why would that be desirable? It hits the right chemical buttons in the brain. Drag it out far enough and we're really aiming at being blissed out brains in jars being fed shots of endorphins at the right intervals.

ball_of_lint 9y ago
https://questionablecontent.net/view.php?comic=3662 https://questionablecontent.net/view.php?comic=3662
psyc 9y ago
I think I'm partial to a variant of wireheading that sort of linearly shifts our perception of pain and pleasure. Getting an arm hacked off is like a bad headache, normal undesirable things are like a minor ache, normal day-to-day is like a fun night out, and orgasm is like ... I don't know, heroin I guess.
- toomanybeersies 9y ago
  I don't know if the human brain could handle that. If you have too many fun nights out, they start to wear. If you take too many drugs, they start to lose the magic, they just become normal. You need the highs with the lows.
  - spondyl 9y ago
    I suppose if we got to that point, you could replace that portion of the brain with cybernetics, save the state before having taken any drugs then every so often, flash it back to the beginning?
    - Godel_unicode 9y ago
      If you haven't read Peter F Hamilton's Commonwealth saga, you might appreciate it. Memory editing plus effective immortality is an interesting concept.

toomanybeersies 9y ago

Speaking of the effect this would have on peoples memories, there's also the potential to use these tools to gaslight [1] someone. An abuser could make images where a person was at an event they were never at, or with a person they never met. > "You've totally met Steve before, here's a photo of you with him, how do you not remember?" An abuser could even more effectively tear down someones reality than ever before. If they were having an affair with someone they just met, they could claim to be old school friends catching up, just insert them into an old photo. Obviously, it's not all bad. There is the potential for this to be used for good as well, but I'm a pessimist. [1] https://en.wikipedia.org/wiki/Gaslighting https://en.wikipedia.org/wiki/Gaslighting

Bartweiss 9y ago
I mean, there's presumably a very short window for that before photo evidence becomes unconvincing to people. The first time a Senator gets "exposed" for some misdeed but proves the evidence is fake, "there's a photo of this" loses its punch. The surrealism of seeing a fake recreation of oneself might have some impact, but we handled ultra-realistic paintings alright. It does touch on an interesting point, though: we've had roughly 100 years in which photo and audio recreations of events constitute "hard evidence" beyond our ability to fully falsify. It appears that within the next ~20 years we'll lose that reliability - footage of a politician making a dirty deal or a businessman engaging in conspiracy will become deniable not just as a misleading edit, but as outright fabrication. What do we do at that point? Do smartphone videos get automatically hashed and uploaded to a blockchain somewhere, so that we can prove when the video came into being? Do we return to an 1850s sense of news, where claims effectively cease to be falsifiable except via personal experience? Are we ready for any of this?
- ryacko 9y ago
  That's not really true. Maybe fifty years when cameras were of a sufficient quality that touchups would be noticed compared to a photorealistic painting.
  - Paraesthetic 9y ago

djsumdog 9y ago

If we really had the Holodeck from Star Trek TNG, one of the first five uses would most likely be porn and/or a brothel.

icc97 9y ago

People have been able to put celebrity faces on porn photos for decades. I don't see how this is significantly different. We could create a viral picture of Trump killing someone now.