17 ms·

You know, I thought that deepfake videos would be politically weaponized when I first heard about them. However, after doing more thinking on this, we have had

You know, I thought that deepfake videos would be politically weaponized when I first heard about them. However, after doing more thinking on this, we have had photoshop for 30 years already! We see photoshopped images all the time and while some people can be fooled, many others remain skeptical of an image then try to verify it hasn't been altered. I don't think photoshopping has really been a big problem yet, which makes me think that deepfakes won't be one either because it is fundamentally the same kind of deception but in video form.

loceng 7y ago
Audio-video is much more stimulating and convincing because it mimics real life more than still images.
- cwkoss 7y ago
  I feel like we just need some comedians to make a bunch of entertaining, realistic but labelled-fake content with deepfakes. Production cost of making a show where each actor is deepfaked into a world leader or dead historical figure or whatnot is not a significant hurdle.
  - shearskill 7y ago
    There is The Fakening channel on YouTube that does this - clearly labeled fake: https://m.youtube.com/channel/UC5D-8hVVwLB0DNrcSBqoVxg https://m.youtube.com/channel/UC5D-8hVVwLB0DNrcSBqoVxg
  - dillonmckay 7y ago
    Like this Jordan Peele / Obama PSA? https://m.youtube.com/watch?v=cQ54GDm1eL0 https://m.youtube.com/watch?v=cQ54GDm1eL0
    - cwkoss 7y ago
      That was a good start!
- jalgos_eminator 7y ago
  Yes, I realize that and photoshopping got a bunch of press for being used on modelling pictures to "enhance" the models before putting them in magazines. These deepfakes will probably be used to do some other similar things as well. My point was that deepfakes aren't anything new and we already have the tools to analyze them. Those tools just aren't computer programs, they are people posting videos on youtube going pixel-by-pixel to show how a certain photo was doctored. After all, a video is just a series of photographs. I think writing computer programs designed to spot these deepfake videos would be very helpful as the volume of doctored videos increases, but this isn't some disruptive technology (at least for people trying to deceive others).
  - chrisco255 7y ago
    You're kidding yourself. A large majority of Americans still believe Sarah Palin said she could see Russia from her house, and that was SNL satire. It will be very difficult to undo the damage done by a convincing and well-timed deep fake. Especially a fake that people want to believe.
mamon 7y ago
This scepticism is itself a problem. There's a whole branch of philosophy that claims that the objective truth is impossible to know. With deepfakes that's even more true, and might drive a lot of people into despair and apathy.
- hanniabu 7y ago
  Exactly, I have shown my friends media of their favorite politician contradicting himself and their response is fake news
- lopmotr 7y ago
  We'll still have provenance and trusted organizations which is what we mainly use to verify important and easily faked things like written words, photos, and videos that might be taken from a different context to what their descriptions claim. There are other techniques people have developed to verify things too, like the group recitals that transmitted the old testament orally for multiple generations. You couldn't just edit it and repeat a fake version because the change would have conflicted with the consensus. Society survived before videos and photos, when all information was easily edited. I think we'll be fine. Maybe we're just in a brief decade or two where we became complacent at believing all videos were real without taking any of the care that we used to take with grainy films of alien autopsies or spoken testimonies of people who claimed to have seen bigfoot.
  - anigbrowl 7y ago
    We'll still have provenance and trusted organizations Oh boy are you in for a rude awakening. It doesn't matter what smart people believe if enough stupid people are convinced of something else. You're using examples from times of very low information distribution to form expectations about the opposite condition, which is already problematic, and ignoring all nonsensical superstition that used to be the norm. When I was growing up I remember a minor local mania over a supposed miracle at a religious shrine which became a summer sensation. People were charting tour buses to say prayers and hoping to witness a miracle themselves. Right now in the US we have a community of people who have been enthusiastically chanting at political rallies about locking their opponents up for the last 3 years without any apparent care for evidence or factual basis. Obviously political rallies are known for their hyperbole but at some point you have to feed the beast.
umvi 7y ago
Yeah the bigger problem is taking video footage of a politician, and then going frame by frame to find the most unflattering possible depiction of them (usually right after a cough or a sneeze) so you can use it to "support" your trash click bait headline. No deep fakes needed - you can make anyone look like a raving lunatic if you take the frame right before a sneeze.
- peacelilly 7y ago
  The problem with deep fakes is a hostile nation taking over your phone/facetime calls and sounding exactly like your own parents. How can you tell if they can do it in real time? A bad actor could get you to do some really bad things.
  - jalgos_eminator 7y ago
    That is an interesting point, but this already happens on voice calls. My grandma got a call a while ago from someone claiming to be my brother. Said he needed money because he was in a South American jail or something. Luckily shes still pretty sharp, so she hung up and called my brother (he was not in South America) so the ruse was up. She was pretty shaken up though. A video call would be more convincing but only an incremental, not fundamental, difference.
    - narag 7y ago
      My mother received a similar call, telling her that I'd had an accident. If you're thinking such an evil persons should be in jail, don't worry, they are! It's them who are in South American prisons using burners or stolen phones.
      - ibejoeb 7y ago
        That's not a prisoner wardialing on a smuggled phone, it's a well-know scam targeting seniors: https://www.aarp.org/money/scams-fraud/info-2018/grandparent-scam-scenarios.html https://www.aarp.org/money/scams-fraud/info-2018/grandparent...
mtgx 7y ago
I remember there was some oil companies-backed anti-Tesla propaganda image a while ago showing the "environmental disaster a lithium mine creates," which went viral for a bit. It was, I think, a tar sands mine. There's no way deepfake videos won't make the propaganda situation worse, at least for a while.
VikingCoder 7y ago
All of these things make it easier to mass-produce bullshit at low cost. I'm pretty sure I know people who have been convinced by meme quotes. A headshot of a politician they don't like, with text overlaid, which they never said. People are outraged! And never bother to inspect the source. Anything that makes it easier to lie about what someone said or did, or makes it harder to disprove... They're all politically weaponized, already. Look at the "drunk pelosi" video.
- mistermann 7y ago
  > I'm pretty sure I know people who have been convinced by meme quotes. A headshot of a politician they don't like, with text overlaid, which they never said. People are outraged! And never bother to inspect the source. I really wonder which type of meme has the most influence on average, straightforward and outright lies like the one you've noted, or the more subtle, subversive social commentary style. I'm a big fan of the latter, I think they're very interesting and underappreciated. For example, this one - nothing more than a simple screenshot of Twitter, but to me this seems very persuasive: http://magaimg.net/img/80rb.jpg http://magaimg.net/img/80rb.jpg Pointing out hypocritical grandstanding: https://i.redd.it/74n4exoy2g131.jpg https://i.redd.it/74n4exoy2g131.jpg Media bias: https://i.redd.it/gtrq4xgemtx21.jpg https://i.redd.it/gtrq4xgemtx21.jpg If Biden runs will be interesting to see how much airplay this meme will get: https://i.imgur.com/tqzGS6E.mp4 https://i.imgur.com/tqzGS6E.mp4 Laughing at the silliness of popular narratives: https://i.redd.it/a9wrex3ijc231.jpg https://i.redd.it/a9wrex3ijc231.jpg Just for a laugh: https://i.redd.it/i5bvml5m92131.jpg https://i.redd.it/i5bvml5m92131.jpg Laughing at logical inconsistency: https://i.redd.it/rp9ydf0s88y21.jpg https://i.redd.it/rp9ydf0s88y21.jpg An interesting way of looking at Brexit: https://i.redd.it/cs6o72p3dp031.png https://i.redd.it/cs6o72p3dp031.png Historical hypocrisy on border control: https://i.redd.it/983sm9wjley21.png https://i.redd.it/983sm9wjley21.png All of these are from t_d so obviously one-sided, I'm sure a similarly impressive collection from the other perspective could easily be assembled, and it's not that uncommon to encounter otherwise intelligent people who have obviously had their beliefs shaped by those memes.
  - VikingCoder 7y ago
newsbinator 7y ago
The best way to fool someone isn't to do an indistinguishable Photoshop job. It's to do a passable-enough fake of something the person wanted to believe anyway. I see this technology as no different.
- contravariant 7y ago
  Although in most cases doctoring an image isn't even necessary, you just need to put it in a misleading context.
  - sjwright 7y ago
    https://en.wikipedia.org/wiki/You_didn%27t_build_that https://en.wikipedia.org/wiki/You_didn%27t_build_that
mortenjorck 7y ago
We’ve had photo manipulation without the need of a darkroom or skilled optical retouchers for 30 years, but weaponized photo manipulation has been a thing since Stalin’s censors airbrushed out Trotsky a century ago.
- jalgos_eminator 7y ago
  Yes, this is true. However, good quality photo editing became relatively cheap and convincing in more recent years. So now you don't need to be a nation-state to be able to convincingly pull something like that off. You can just be some guy in a basement with $1000 worth of computing gear and experience using photoshop.
1PlayerOne 7y ago
I agree, it was fake news articles on Facebook that spread false information but it took desperately ignorant people to believe it for the consequent chaos to ensue. So while deepfake videos are scary, I think what we have to really worry about is the deep ignorance of the voters.
- maxxxxx 7y ago
  From my observation I believe that a lot of educated and less educated people don’t really care if something is fake as long it confirms their opinions. They don’t want to let go of their “facts” although they know they are wrong.
- dylan604 7y ago
  Isn't the deep ignorance of the voters the entire point of a deep fake? It's knowingly a fake, so by creating it you are already trying to pull one over on someone. When the president of the US can say "I never said that" even with video/audio evidence of him saying it while also screaming about deep fakes, the slippery slope is being greased. It's not hard to believe that viewers that only get information from a single source will fall for it. Even if they hear arguments it is fake, they will not research it on their own because their single source is never wrong.
soulofmischief 7y ago
The problem is that just like "fake news", deep fakes will provide alibis for people caught doing real crimes. And their fanbases will listen because it's easier than accepting their idol could be a bad actor.
el_benhameen 7y ago
I don't think that fakes (photoshop, deepfakes, whatever) need to be absolutely believable to be effective. The long-game purpose is to erode trust in institutions, media, politicians, etc. Fakes accomplish this goal by being just believable and just frequent enough that more and more people start deciding to believe whatever it is they want to believe because "who knows what the real truth is!".
crazygringo 7y ago
Totally agreed. Writers have been able to write nonsense for a long time... and photo manipulation we've gotten quite used to. All we do is add video to the category of things that might be lies, and so need independent verification. Skepticism is good and healthy, and verification in the age of Google isn't that hard. You can trust that if the NY Times or CBS publishes a video, they verified its authenticity, or else will be publishing a big retraction within a few days that will also make the news because it's so rare. Whether your uncle sends you a random photo or a video of a politician that seems too exaggerated or weird or unbelievable... you assume it might be manipulated... as you already do now. Making Nancy Pelosi seem drunk didn't take a deepfake, just slowing it down. It's not any kind of big change. Just applying the same skepticism we already automatically apply to so many other things.
- HeWhoLurksLate 7y ago
  > You can trust that if the NY Times or CBS publishes a video, they verified its authenticity, or else will be publishing a big retraction within a few days that will also make the news because it's so rare. This may be, or become false, due to political motivation to seriously damage the "other side of the aisle".
- oefrha 7y ago
  In fact, often times you don’t even need to lie to skew the “truth”. Cherry picking facts or even just highlighting certain facts over others, plus an optional bit of extrapolation or subtle misinterpretation, is often enough to fit whatever narrative you want to push. > and verification in the age of Google isn't that hard. It’s hard because publications often parrot each other. You walk away confident of your “verified” truth due to echo chamber effect, which might be worse than not verifying at all. > You can trust that if the NY Times or CBS publishes a video... I can’t. Again, you don’t need to make factual mistakes to push an agenda.
siidooloo 7y ago
Mostly people seem to be sceptical of things they already don’t believe. If someone repeats something you believe, how much research are you going to do. So photoshopped images that reinforce your beliefs slip by, and the one that challenge you, you catch. Or worse, the ones that challenge you get labeled as photoshopped regardless of their provenance.
nihonde 7y ago
We’ve come to learn that images and audio can’t be trusted. It was inevitable that video would fall as a trusted source. Next up: the person you’re sitting across from at dinner.
- Izkata 7y ago
  Some people already experience this: https://en.wikipedia.org/wiki/Capgras_delusion https://en.wikipedia.org/wiki/Capgras_delusion
fiblye 7y ago
Photoshopping is done by hand and generally has mistakes. Good photoshops are still believed. Videos are being altered by machines. They’re being optimized for natural looking results. It’s harder to notice small mistakes when frames are going by at 24FPS vs poring over a static image for 30 seconds until you finally notice the one region with mismatched shadows or odd clipping.
- naniwaduni 7y ago
  On the bright side, video gives a lot more opportunities to make small mistakes for conspiracy theorists, er, fact-checkers to find!
  - HeWhoLurksLate 7y ago
    "One person's freedom fighter is another's terrorist."
- tuesdayrain 7y ago
  I've literally never been able to identify a photoshopped image (except for immediately obvious work), without someone first pointing it out. I have a feeling that the percentage of the population that can spot edited images is in the single digits.
  - jgtrosh 7y ago
    As someone who usually spots the Photoshop, I have some trouble assessing the danger of such techniques; thanks for bringing your input. I feel that someone who sees “through” a doctored piece of information will not even realize the power it may have had to others who might not participate in the conversation but end up part of the bubble nonetheless. By the time a fake has been debunked it's too late—but what's the alternative, censorship?
    - edraferi 7y ago
      Not censorship, context. Censorship is disrespectful of the reader; it assumes the authority knows better. Context is respectful; it assumes you will make the best decision (for you) when you have all the relevant information. So don’t delete the fake video. Put a big red exclamation mark next to it that says “this video has been substantially manipulated. Contents may not be genuine.” Also: while viewers and producers both deserve the same respect, producers can forfeit theirs by consistently failing to respect their viewers. A consistent pattern of intentional deception should earn a shadow ban.
empath75 7y ago
Not being able to believe realistic looking video is in itself a problem. People are simply not going to believe news anymore.
- dsfyu404ed 7y ago
  God forbid media outlets are forced to rely on reputation.
maxxxxx 7y ago
I think the problem is that if we can’t trust video then there is really nothing visual left we can trust. Until now you could at least trust video recordings to some degree. Not sure if that a good thing or not.
ruytlm 7y ago
There are also many useful tools for the skeptic with regard to edited images: http://fotoforensics.com/ http://fotoforensics.com/ It will be interesting to see if such tools are developed for video as well.
Paul-ish 7y ago
Doesn't a lot of the "fake news" use photoshop?
pergadad 7y ago
The REAL issue here will not be the fake videos themselves. They will cause many messes, but the real issue is an acceleration of what we see today: a loss of trust in information and in particular the established media. More societal rift, easy to dismiss any negative news about your favourite politician/rapper/.. as fake video; more difficult court cases even where there's video evidence, ..... Terrifying.
- creaghpatr 7y ago
  >a loss of trust in information and in particular the established media. Yeah, the trust is not coming back, regardless of fake videos.
ACow_Adonis 7y ago
You don't think that photoshopping has really been a problem and you think people remain skeptical? I guess if you think that epidemics regarding images of male/female body image, body dismorphia, self-harm, anxiety, and using celebrities to sell products aren't connected to it, but I've found exactly the opposite. I love photography and I am utterly unable to talk to non-photographers or convince them about what happens in the production of most images they see in most forms of commercial media. It goes something like this: "Hey ACowAdonis, how much of that photo do you think was retouched?" looks at photo "All of it". "All of it? What do you mean?" "I mean all of it." "But that's Reese Witherspoon! (or insert popular celebrity here)" "Yep, and you can see how her eyes have been adjusted, her skins been adjusted, they've changed the shape of her arm, taken a few pounds off the mid section, increased the boob size, changed the colour of her hair...and i'm pretty sure that's not her hand". "Nah, you crazy..." "You want crazy...pretty much every photo in every fashion magazine and every media item involving that celebrity has been adjusted to a similar extent" "Nah mate, you're having me on. You're nuts."
bryanrasmussen 7y ago
Here's how it will work, someone will make a deepfake of a political opponent and then publish it on a forum where like minded people gather using a dummy account. Other dummy accounts will take the deepfake and start making a narrative around it, sending chain emails to their real world contacts. Real world contacts will start passing around deepfake chain mail they were sent. Some of these emails will take the deepfake as true, some will talk of it as being a funny parody, but "funny because it's true" anyway. Major news organizations can now address the issue as news because people are passing it around, maybe it will be something like 'Well Bob, I think the X have a real image problem on their hand, if the video is true or not..' You don't mean to say you think it's true!? "I didn't say that Bob, I'm frankly not qualified to judge and I haven't done any research what I'm worried about here is that there is a perception that it is true or if it is not exactly true in this particular instance that it might be true, and that is what I mean by a real image problem"
mk89 7y ago
Video is way worse, because it's connected to audio. Which means "did you hear that? He just said he wants to go to war...".
adrianN 7y ago
People know about photo manipulations and get suspicious because we've had Photoshop for thirty years (and analog photomanipulation even longer) and see them all the time. This wasn't always true. When photography was new, manipulations that wouldn't fool anyone today were taken as proof by many people. See for example https://en.wikipedia.org/wiki/Cottingley_Fairies https://en.wikipedia.org/wiki/Cottingley_Fairies
goshx 7y ago
Photoshop has been used for years to successfully fool millions of men and women that consume magazines showing people with smooth skin and sexy bodies.
- donkeyd 7y ago
  This is exactly what I wanted to post. People are becoming insecure about their bodies because of fake images of famous people. It creates high expectations that can never be met in real life and seriously ruins lives.

loceng 7y ago

Audio-video is much more stimulating and convincing because it mimics real life more than still images.

cwkoss 7y ago
I feel like we just need some comedians to make a bunch of entertaining, realistic but labelled-fake content with deepfakes. Production cost of making a show where each actor is deepfaked into a world leader or dead historical figure or whatnot is not a significant hurdle.
- shearskill 7y ago
  There is The Fakening channel on YouTube that does this - clearly labeled fake: https://m.youtube.com/channel/UC5D-8hVVwLB0DNrcSBqoVxg https://m.youtube.com/channel/UC5D-8hVVwLB0DNrcSBqoVxg
- dillonmckay 7y ago
  Like this Jordan Peele / Obama PSA? https://m.youtube.com/watch?v=cQ54GDm1eL0 https://m.youtube.com/watch?v=cQ54GDm1eL0
  - cwkoss 7y ago
    That was a good start!
jalgos_eminator 7y ago
Yes, I realize that and photoshopping got a bunch of press for being used on modelling pictures to "enhance" the models before putting them in magazines. These deepfakes will probably be used to do some other similar things as well. My point was that deepfakes aren't anything new and we already have the tools to analyze them. Those tools just aren't computer programs, they are people posting videos on youtube going pixel-by-pixel to show how a certain photo was doctored. After all, a video is just a series of photographs. I think writing computer programs designed to spot these deepfake videos would be very helpful as the volume of doctored videos increases, but this isn't some disruptive technology (at least for people trying to deceive others).
- chrisco255 7y ago
  You're kidding yourself. A large majority of Americans still believe Sarah Palin said she could see Russia from her house, and that was SNL satire. It will be very difficult to undo the damage done by a convincing and well-timed deep fake. Especially a fake that people want to believe.

mamon 7y ago

This scepticism is itself a problem. There's a whole branch of philosophy that claims that the objective truth is impossible to know. With deepfakes that's even more true, and might drive a lot of people into despair and apathy.

hanniabu 7y ago
Exactly, I have shown my friends media of their favorite politician contradicting himself and their response is fake news
lopmotr 7y ago
We'll still have provenance and trusted organizations which is what we mainly use to verify important and easily faked things like written words, photos, and videos that might be taken from a different context to what their descriptions claim. There are other techniques people have developed to verify things too, like the group recitals that transmitted the old testament orally for multiple generations. You couldn't just edit it and repeat a fake version because the change would have conflicted with the consensus. Society survived before videos and photos, when all information was easily edited. I think we'll be fine. Maybe we're just in a brief decade or two where we became complacent at believing all videos were real without taking any of the care that we used to take with grainy films of alien autopsies or spoken testimonies of people who claimed to have seen bigfoot.
- anigbrowl 7y ago
  We'll still have provenance and trusted organizations Oh boy are you in for a rude awakening. It doesn't matter what smart people believe if enough stupid people are convinced of something else. You're using examples from times of very low information distribution to form expectations about the opposite condition, which is already problematic, and ignoring all nonsensical superstition that used to be the norm. When I was growing up I remember a minor local mania over a supposed miracle at a religious shrine which became a summer sensation. People were charting tour buses to say prayers and hoping to witness a miracle themselves. Right now in the US we have a community of people who have been enthusiastically chanting at political rallies about locking their opponents up for the last 3 years without any apparent care for evidence or factual basis. Obviously political rallies are known for their hyperbole but at some point you have to feed the beast.

umvi 7y ago

Yeah the bigger problem is taking video footage of a politician, and then going frame by frame to find the most unflattering possible depiction of them (usually right after a cough or a sneeze) so you can use it to "support" your trash click bait headline. No deep fakes needed - you can make anyone look like a raving lunatic if you take the frame right before a sneeze.

peacelilly 7y ago
The problem with deep fakes is a hostile nation taking over your phone/facetime calls and sounding exactly like your own parents. How can you tell if they can do it in real time? A bad actor could get you to do some really bad things.
- jalgos_eminator 7y ago
  That is an interesting point, but this already happens on voice calls. My grandma got a call a while ago from someone claiming to be my brother. Said he needed money because he was in a South American jail or something. Luckily shes still pretty sharp, so she hung up and called my brother (he was not in South America) so the ruse was up. She was pretty shaken up though. A video call would be more convincing but only an incremental, not fundamental, difference.
  - narag 7y ago
    My mother received a similar call, telling her that I'd had an accident. If you're thinking such an evil persons should be in jail, don't worry, they are! It's them who are in South American prisons using burners or stolen phones.
    - ibejoeb 7y ago
      That's not a prisoner wardialing on a smuggled phone, it's a well-know scam targeting seniors: https://www.aarp.org/money/scams-fraud/info-2018/grandparent-scam-scenarios.html https://www.aarp.org/money/scams-fraud/info-2018/grandparent...

mtgx 7y ago

I remember there was some oil companies-backed anti-Tesla propaganda image a while ago showing the "environmental disaster a lithium mine creates," which went viral for a bit. It was, I think, a tar sands mine. There's no way deepfake videos won't make the propaganda situation worse, at least for a while.

VikingCoder 7y ago

All of these things make it easier to mass-produce bullshit at low cost. I'm pretty sure I know people who have been convinced by meme quotes. A headshot of a politician they don't like, with text overlaid, which they never said. People are outraged! And never bother to inspect the source. Anything that makes it easier to lie about what someone said or did, or makes it harder to disprove... They're all politically weaponized, already. Look at the "drunk pelosi" video.

mistermann 7y ago
> I'm pretty sure I know people who have been convinced by meme quotes. A headshot of a politician they don't like, with text overlaid, which they never said. People are outraged! And never bother to inspect the source. I really wonder which type of meme has the most influence on average, straightforward and outright lies like the one you've noted, or the more subtle, subversive social commentary style. I'm a big fan of the latter, I think they're very interesting and underappreciated. For example, this one - nothing more than a simple screenshot of Twitter, but to me this seems very persuasive: http://magaimg.net/img/80rb.jpg http://magaimg.net/img/80rb.jpg Pointing out hypocritical grandstanding: https://i.redd.it/74n4exoy2g131.jpg https://i.redd.it/74n4exoy2g131.jpg Media bias: https://i.redd.it/gtrq4xgemtx21.jpg https://i.redd.it/gtrq4xgemtx21.jpg If Biden runs will be interesting to see how much airplay this meme will get: https://i.imgur.com/tqzGS6E.mp4 https://i.imgur.com/tqzGS6E.mp4 Laughing at the silliness of popular narratives: https://i.redd.it/a9wrex3ijc231.jpg https://i.redd.it/a9wrex3ijc231.jpg Just for a laugh: https://i.redd.it/i5bvml5m92131.jpg https://i.redd.it/i5bvml5m92131.jpg Laughing at logical inconsistency: https://i.redd.it/rp9ydf0s88y21.jpg https://i.redd.it/rp9ydf0s88y21.jpg An interesting way of looking at Brexit: https://i.redd.it/cs6o72p3dp031.png https://i.redd.it/cs6o72p3dp031.png Historical hypocrisy on border control: https://i.redd.it/983sm9wjley21.png https://i.redd.it/983sm9wjley21.png All of these are from t_d so obviously one-sided, I'm sure a similarly impressive collection from the other perspective could easily be assembled, and it's not that uncommon to encounter otherwise intelligent people who have obviously had their beliefs shaped by those memes.
- VikingCoder 7y ago

newsbinator 7y ago

The best way to fool someone isn't to do an indistinguishable Photoshop job. It's to do a passable-enough fake of something the person wanted to believe anyway. I see this technology as no different.

contravariant 7y ago
Although in most cases doctoring an image isn't even necessary, you just need to put it in a misleading context.
- sjwright 7y ago
  https://en.wikipedia.org/wiki/You_didn%27t_build_that https://en.wikipedia.org/wiki/You_didn%27t_build_that

mortenjorck 7y ago

We’ve had photo manipulation without the need of a darkroom or skilled optical retouchers for 30 years, but weaponized photo manipulation has been a thing since Stalin’s censors airbrushed out Trotsky a century ago.

jalgos_eminator 7y ago
Yes, this is true. However, good quality photo editing became relatively cheap and convincing in more recent years. So now you don't need to be a nation-state to be able to convincingly pull something like that off. You can just be some guy in a basement with $1000 worth of computing gear and experience using photoshop.

1PlayerOne 7y ago

I agree, it was fake news articles on Facebook that spread false information but it took desperately ignorant people to believe it for the consequent chaos to ensue. So while deepfake videos are scary, I think what we have to really worry about is the deep ignorance of the voters.

maxxxxx 7y ago
From my observation I believe that a lot of educated and less educated people don’t really care if something is fake as long it confirms their opinions. They don’t want to let go of their “facts” although they know they are wrong.
dylan604 7y ago
Isn't the deep ignorance of the voters the entire point of a deep fake? It's knowingly a fake, so by creating it you are already trying to pull one over on someone. When the president of the US can say "I never said that" even with video/audio evidence of him saying it while also screaming about deep fakes, the slippery slope is being greased. It's not hard to believe that viewers that only get information from a single source will fall for it. Even if they hear arguments it is fake, they will not research it on their own because their single source is never wrong.

soulofmischief 7y ago

The problem is that just like "fake news", deep fakes will provide alibis for people caught doing real crimes. And their fanbases will listen because it's easier than accepting their idol could be a bad actor.

el_benhameen 7y ago

I don't think that fakes (photoshop, deepfakes, whatever) need to be absolutely believable to be effective. The long-game purpose is to erode trust in institutions, media, politicians, etc. Fakes accomplish this goal by being just believable and just frequent enough that more and more people start deciding to believe whatever it is they want to believe because "who knows what the real truth is!".

crazygringo 7y ago

Totally agreed. Writers have been able to write nonsense for a long time... and photo manipulation we've gotten quite used to. All we do is add video to the category of things that might be lies, and so need independent verification. Skepticism is good and healthy, and verification in the age of Google isn't that hard. You can trust that if the NY Times or CBS publishes a video, they verified its authenticity, or else will be publishing a big retraction within a few days that will also make the news because it's so rare. Whether your uncle sends you a random photo or a video of a politician that seems too exaggerated or weird or unbelievable... you assume it might be manipulated... as you already do now. Making Nancy Pelosi seem drunk didn't take a deepfake, just slowing it down. It's not any kind of big change. Just applying the same skepticism we already automatically apply to so many other things.

HeWhoLurksLate 7y ago
> You can trust that if the NY Times or CBS publishes a video, they verified its authenticity, or else will be publishing a big retraction within a few days that will also make the news because it's so rare. This may be, or become false, due to political motivation to seriously damage the "other side of the aisle".
oefrha 7y ago
In fact, often times you don’t even need to lie to skew the “truth”. Cherry picking facts or even just highlighting certain facts over others, plus an optional bit of extrapolation or subtle misinterpretation, is often enough to fit whatever narrative you want to push. > and verification in the age of Google isn't that hard. It’s hard because publications often parrot each other. You walk away confident of your “verified” truth due to echo chamber effect, which might be worse than not verifying at all. > You can trust that if the NY Times or CBS publishes a video... I can’t. Again, you don’t need to make factual mistakes to push an agenda.

siidooloo 7y ago

Mostly people seem to be sceptical of things they already don’t believe. If someone repeats something you believe, how much research are you going to do. So photoshopped images that reinforce your beliefs slip by, and the one that challenge you, you catch. Or worse, the ones that challenge you get labeled as photoshopped regardless of their provenance.

nihonde 7y ago

We’ve come to learn that images and audio can’t be trusted. It was inevitable that video would fall as a trusted source. Next up: the person you’re sitting across from at dinner.

Izkata 7y ago
Some people already experience this: https://en.wikipedia.org/wiki/Capgras_delusion https://en.wikipedia.org/wiki/Capgras_delusion

fiblye 7y ago

Photoshopping is done by hand and generally has mistakes. Good photoshops are still believed. Videos are being altered by machines. They’re being optimized for natural looking results. It’s harder to notice small mistakes when frames are going by at 24FPS vs poring over a static image for 30 seconds until you finally notice the one region with mismatched shadows or odd clipping.

naniwaduni 7y ago
On the bright side, video gives a lot more opportunities to make small mistakes for conspiracy theorists, er, fact-checkers to find!
- HeWhoLurksLate 7y ago
  "One person's freedom fighter is another's terrorist."
tuesdayrain 7y ago
I've literally never been able to identify a photoshopped image (except for immediately obvious work), without someone first pointing it out. I have a feeling that the percentage of the population that can spot edited images is in the single digits.
- jgtrosh 7y ago
  As someone who usually spots the Photoshop, I have some trouble assessing the danger of such techniques; thanks for bringing your input. I feel that someone who sees “through” a doctored piece of information will not even realize the power it may have had to others who might not participate in the conversation but end up part of the bubble nonetheless. By the time a fake has been debunked it's too late—but what's the alternative, censorship?
  - edraferi 7y ago
    Not censorship, context. Censorship is disrespectful of the reader; it assumes the authority knows better. Context is respectful; it assumes you will make the best decision (for you) when you have all the relevant information. So don’t delete the fake video. Put a big red exclamation mark next to it that says “this video has been substantially manipulated. Contents may not be genuine.” Also: while viewers and producers both deserve the same respect, producers can forfeit theirs by consistently failing to respect their viewers. A consistent pattern of intentional deception should earn a shadow ban.

empath75 7y ago

Not being able to believe realistic looking video is in itself a problem. People are simply not going to believe news anymore.

dsfyu404ed 7y ago
God forbid media outlets are forced to rely on reputation.

maxxxxx 7y ago

I think the problem is that if we can’t trust video then there is really nothing visual left we can trust. Until now you could at least trust video recordings to some degree. Not sure if that a good thing or not.

ruytlm 7y ago

There are also many useful tools for the skeptic with regard to edited images: http://fotoforensics.com/ http://fotoforensics.com/ It will be interesting to see if such tools are developed for video as well.

Paul-ish 7y ago

Doesn't a lot of the "fake news" use photoshop?

pergadad 7y ago

The REAL issue here will not be the fake videos themselves. They will cause many messes, but the real issue is an acceleration of what we see today: a loss of trust in information and in particular the established media. More societal rift, easy to dismiss any negative news about your favourite politician/rapper/.. as fake video; more difficult court cases even where there's video evidence, ..... Terrifying.

creaghpatr 7y ago
>a loss of trust in information and in particular the established media. Yeah, the trust is not coming back, regardless of fake videos.

ACow_Adonis 7y ago

You don't think that photoshopping has really been a problem and you think people remain skeptical? I guess if you think that epidemics regarding images of male/female body image, body dismorphia, self-harm, anxiety, and using celebrities to sell products aren't connected to it, but I've found exactly the opposite. I love photography and I am utterly unable to talk to non-photographers or convince them about what happens in the production of most images they see in most forms of commercial media. It goes something like this: "Hey ACowAdonis, how much of that photo do you think was retouched?" looks at photo "All of it". "All of it? What do you mean?" "I mean all of it." "But that's Reese Witherspoon! (or insert popular celebrity here)" "Yep, and you can see how her eyes have been adjusted, her skins been adjusted, they've changed the shape of her arm, taken a few pounds off the mid section, increased the boob size, changed the colour of her hair...and i'm pretty sure that's not her hand". "Nah, you crazy..." "You want crazy...pretty much every photo in every fashion magazine and every media item involving that celebrity has been adjusted to a similar extent" "Nah mate, you're having me on. You're nuts."

bryanrasmussen 7y ago

Here's how it will work, someone will make a deepfake of a political opponent and then publish it on a forum where like minded people gather using a dummy account. Other dummy accounts will take the deepfake and start making a narrative around it, sending chain emails to their real world contacts. Real world contacts will start passing around deepfake chain mail they were sent. Some of these emails will take the deepfake as true, some will talk of it as being a funny parody, but "funny because it's true" anyway. Major news organizations can now address the issue as news because people are passing it around, maybe it will be something like 'Well Bob, I think the X have a real image problem on their hand, if the video is true or not..' You don't mean to say you think it's true!? "I didn't say that Bob, I'm frankly not qualified to judge and I haven't done any research what I'm worried about here is that there is a perception that it is true or if it is not exactly true in this particular instance that it might be true, and that is what I mean by a real image problem"

mk89 7y ago

Video is way worse, because it's connected to audio. Which means "did you hear that? He just said he wants to go to war...".

adrianN 7y ago

People know about photo manipulations and get suspicious because we've had Photoshop for thirty years (and analog photomanipulation even longer) and see them all the time. This wasn't always true. When photography was new, manipulations that wouldn't fool anyone today were taken as proof by many people. See for example https://en.wikipedia.org/wiki/Cottingley_Fairies https://en.wikipedia.org/wiki/Cottingley_Fairies

goshx 7y ago

Photoshop has been used for years to successfully fool millions of men and women that consume magazines showing people with smooth skin and sexy bodies.

donkeyd 7y ago
This is exactly what I wanted to post. People are becoming insecure about their bodies because of fake images of famous people. It creates high expectations that can never be met in real life and seriously ruins lives.