5 ms·
Stop Worrying About Deepfakes
- Solvency 3y agoUh no thanks I'll remain rightfully and objectively terrified by them into the foreseeable future.
- divan 3y agoTwo last words from the title could be omitted :)
- mike_hock 3y agoStop worrying and consoom product.
- pityJuke 3y agoFrom a skim: while I agree with surface level details about deepfakes (i.e. they're mostly used for funny memes, humans are mostly capable of detecting them), I am still slightly perturbed by people using it to generate NSFW porn of people (particularly underaged ones) without their consent [0]. Very much a "four horsemen of infopocalypse" statement, that'll I'll concede. [0]: https://english.elpais.com/international/2023-09-18/in-spain-dozens-of-girls-are-reporting-ai-generated-nude-photos-of-them-being-circulated-at-school-my-heart-skipped-a-beat.html https://english.elpais.com/international/2023-09-18/in-spain...
- colpabar 3y agoWhat really bothers me is when people here reply to stories like this and say things like "well those girls shouldn't feel bad at all, it's just nudity, our society is so prude and _that's_ the _real_ problem." I don't know what the solution is, I'm not suggesting anything draconian - I just really don't like the idea that we should tell these girls to just get over it.
- sickofparadox 3y ago>"There was huge concern right away that you’d have videos appear in a political context that could change the course of an election or lead to political violence. But none of that has transpired." This kind of "it hasn't happened yet so it won't" dismissal of the ever-closer ability to create a perfect fake video of X person saying this or that is so myopic I feel like it doesn't even deserve elaboration as to why it is wrong, we should skip straight to mockery and derision. We've already had multiple cases of fake Biden and fake Trump videos posted to the internet with hundreds of thousands of views before any kind of clarification came to indicate they were fake.[1] 2024 will put this to the test, and I have little confidence that this will remain the case. [1] https://www.bbc.com/news/62338593 https://www.bbc.com/news/62338593
- willsoon 3y agoWell, yes. I saw Biden recite a copipasta from beginning to end. I still marvel at how well it's done. The skill of the AI or whatever, or the person who did it, approaches art. I still don't believe for a second that it's real, because it's a copypasta, you know? And especially because I am a human being with normal intelligence.
- sickofparadox 3y agoOk that's wonderful but a bit of a red herring. I'm not worried about the AI presidents gaming channels that are out there with Trump Obama and Biden playing Minecraft together, I'm worried about "new leaked audio from our undercover reporter of Biden telling the head of the FBI to sink Trump's campaign" or "Video leak of Trump calling for the intimidation of voters in blue states" exploding on the internet with no real way to confirm or deny it. You may say you're a human being with normal intelligence, but I don't have a ton of faith that people would be able to tell one way or the other - especially younger people who seem much more likely to believe things on the internet. We already have cybercriminals using AI voicechangers to impersonate people's coworkers to game helpdesks for breaking into systems.[1] This is a tool that can be used for fun but it's as game changing as the printing press, possible more. https://www.pcmag.com/news/hacker-deepfakes-employees-voice-in-phone-call-to-breach-it-company https://www.pcmag.com/news/hacker-deepfakes-employees-voice-...
- beej71 3y agoThis is an interesting take given that deepfake images are being used right now for propaganda in the Israel/Hamas conflict. Videos are three-sense. People believe that stuff far more easily than they believe something they read. And couple it with the fact that people want to believe the propaganda and you have a massive political lever. So I'm only not worried insofar as I'm not worried that politicians and superPACs will not utilize a massive political lever.
- breuleux 3y ago> People believe that stuff far more easily than they believe something they read. I'm not convinced it's "far" more. People believe things they read extremely easily when they say what they want to hear. Propaganda is already efficient enough that there is little room for improvement. As for people who question what they read, they will also question what the see once they become aware of the power of deepfakes. That's if they even watch the videos. I generally don't, because it's a waste of time when trustworthy people can watch them for me and tell me what's in them.
- The_Colonel 3y agoPeople not believing (real) photographic / video evidence is not great either. There's already this fronge group claiming that war in Ukraine is fake, but I expect such things to move more mainstream with generative AI.
- pphysch 3y agoIdeology is believing things a priori, sometimes despite any available evidence. There will always be ideology and ideologues, but it is sort of an orthogonal discussion to TFA. Ideologues simply don't care about the evidence, deepfaked or not, otherwise they wouldn't be ideologues.
- The_Colonel 3y agoThis is a very binary view. Every person is to a degree an ideologue, and to a degree believes evidence. Shifting the scale from "videographic evidence is pretty trustworthy" to "any video can be a fake and you have no chance to detect a difference" will make a big dent.
- Yizahi 3y agoStop worrying about deepfakes, as in "we can't do anything about them and have to resign to have unrealiable media evidence from now and till forever.". Don't worry about that, right? Also this professor's methodology is laughable. He is surveying popular deepfakes on the popular sites. OF COURSE they will be jokes. Who will share and view a million times a deepfake of some CCTV with a face of some robber substituted for some other equally unknown guy. Or a deepfake of a car crash with car plates swapped for different ones. Etc. "We were worried that they will affect elections or politicians, but none of that has transpired." Says who? Who did this research? How was this determined? By a gut feeling while watching deepfake memes? Thought so.
- NegativeK 3y agoThis feels like an instance of someone else attaching an unfortunate title to an article that's more interesting and nuanced.
- robertlagrant 3y agoI'll bet someone right now is making a deepfake video of this professor saying something horrendous, and circulating it.
- wfh 3y agoI don't think this article will age well.
- cassianoleal 3y agoSure, in a Dr. Strangelove kind of sense.
- sandworm101 3y agoRead history. This has come up countless times. The world did not collapse. Some deepfakery has even been addressed by US courts (Hustler v. Falwell, a literary deepfake). There was the war of the world fiasco, a radio deepfake. Before that people panicked over the ability to edit photographic plates, combining images to make people appear/disappear. Society did not crumble. New technology comes along. People fear that it can be used to create fake news. Then, a few years later, everyone chuckles about it. A few years from now we will have adapted to the current latest deepfake tech and will also chuckle about the panic.
- xnx 3y agoCurrent technology is so much better in its quality and ease of use as to be barely comparable to what came before. A lot of people in this thread seem to pride themselves on being able to spot deepfakes (how do they know the ones they don't spot?), but no person or machine will be able to tell real from deepfake in 5 years. I'm not sure what the effects will be of not being able to trust any photo or video (e.g. surveillance video, drone footage, etc.)
- deleted 3y ago[deleted]
- Dalewyn 3y agoInformation has been faked, to varying degrees of success, for as long as humanity has engaged in intrigue. "AI" does not change this, it's still ill-willed humans and trolls at the wheel faking information. I always roll my eyes at fears of "AI" faking this, creating that, etc. Whatever "AI" has done or can do, we've already seen much worse from humanity. Been there, done that.
- xnx 3y agoTrue, AI is just the tool and not the perpetrator. Murder has also exist since the dawn of humanity, but a murderer with a stick is very different from one with a fully automatic rifle.
- 3y ago
- xnx 3y ago> There was huge concern right away that you’d have videos appear in a political context that could change the course of an election or lead to political violence. But none of that has transpired. Citation needed for this. Margin for victories has been so small in recent victories that it is very plausible that enough voters have been influenced by fake news accompanied by fabricated/deepfaked images to change outcomes.
- SamBam 3y agoExactly. And it's not a single fake video of Biden promising to jail Trump supporters, which could be shown to be fake. It's dozens of little videos shared on Facebook where politicians are made to look stupider, where their speech is slowed and slurred (they've done this to Biden, Harris and Trump), where false audio is added. We can't accurately track the effects of such videos.
- throwaway743950 3y agoYup, and I'd expect that for an election year there will be a lot more. Even if none of it is directly sponsored by a candidate, supporters will likely create deepfake content, and it will be believable to some percentage of people.
- MichaelZuo 3y agoIt does seem really odd that not even credible arguments are offered in the article. I thought nautil.us was a somewhat reputable publication.
- senectus1 3y agoPlenty of dimwits have been scammed by deepfakes on places like facebook. I work for a business man that is suing meta for this reason. Obviously meta dont produce the deepfakes but they are happy to take advertising money to allow the deepfake adverts to play on their portal.
- matteoraso 3y ago> There was huge concern right away that you’d have videos appear in a political context that could change the course of an election or lead to political violence. But none of that has transpired. This is wildly wrong. https://web.archive.org/web/20190415011409/https://www.washingtonpost.com/nation/2019/01/11/seattle-tv-station-aired-doctored-footage-trumps-oval-office-speech-employee-has-been-fired/?utm_term=.77705fa81c8a https://web.archive.org/web/20190415011409/https://www.washi... https://www.foxnews.com/politics/twitter-erupts-trump-trolls-desantis-ai-generated-video-2024-announcement https://www.foxnews.com/politics/twitter-erupts-trump-trolls... https://www.politifact.com/factchecks/2023/may/05/facebook-posts/kamala-harris-wasnt-slurring-about-today-yesterday/ https://www.politifact.com/factchecks/2023/may/05/facebook-p... https://theconversation.com/faked-videos-shore-up-false-beliefs-about-bidens-mental-health-145975 https://theconversation.com/faked-videos-shore-up-false-beli...
- htk 3y agoThose are not evidence of the contrary. They're attempts, at best.
- digging 3y agoOn the other hand, there's no evidence this stuff isn't influencing elections either, is there? It's happening, and people are believing it, so I'd say it's almost self-evident that it's influencing elections. People usually expect politics to have decisive, iconic moments like Napoleonic battles. And possibly that was true, back in Napoleonic times. But modern politics is much more like modern warfare, which is nuanced and messy and complex. We don't and can't currently track the factors that lead to someone casting their single vote in a particular way (or at all), but we still need to recognize that they are myriad and complex reasons (in the case of someone who can be swayed... many of us are going to vote one way or another virtually regardless of what happens).
- tremon 3y agoThe original assertion was about "none of [videos in a political context that could change the course of an election or lead to political violence] having transpired". Of course a single example of a deepfake appearing in a political context is evidence of the contrary. As formulated, it isn't necessary for either election outcomes or political violence to be attributed to said fake videos, and I would say that demanding that kind of evidence is unreasonable (it's a common denialist tactic to require an absurd level of evidence). So why exactly are those not evidence of the contrary according to you?
- hiAndrewQuinn 3y agoThe true reason to not worry about deepfakes is that both sides of any conflict will learn to use them equally viciously. Like always, the only way out is to take a step back, study things objectively through the lens of economics, and figure out the tradeoffs inherent to the choice. See also: Michael Huemer's "In Praise of Passivity", https://fakenous.substack.com/p/in-praise-of-passivity https://fakenous.substack.com/p/in-praise-of-passivity .
- ks2048 3y agoOthers have pointed this out but it’s possible (or likely) that the biggest harm is just the diluting of the truth so no one believes anything. When someone sees or hears something they don’t want to see or hear (against their political outlook), they will now have plausible deniability that it’s just bogus evidence and will dismiss it.
- gustavus 3y agoRules of the internet 1. Don't believe anything you see or read on the internet. 2. Don't post any personally identifiable information about yourself on the internet. 3. Every woman is a man, every teenager is an FBI agent, and every man is a dog. Every single problem or controversy surrounding the internet derives from breaking one of these three rules. If we just started teaching kids these again we wouldn't have the problems that we do.
- xg15 3y agoIt's also worth noting that there far stupider methods that can (right now) generate much more convincing images than deepfakes. The simplest is taking an existing, real picture and taking it out of context, lying about what the image shows, etc. This is actively being done in current conflicts, e.g. taking real footage from the Syrian civil war or from previous wars in Gaza and presenting them as photos from the current war. It works so well because there are enough absolutely horrible photos from the current war, so the fake photo appears plausible. If AI-generated imagery should ever reach the level of being completely artefact-free and absolutely indistinguishable from real photos, then deepfakes will be about on par with the propaganda effect of today's real photos.
- ufmace 3y agoAgreed. Most of the propaganda videos I see around are more like things taken out of context. When you see a battle or atrocity video, it's hard to be sure where it was actually filmed, when it was actually filmed, who each side actually is, what happened before and after the camera rolled, what is happening outside the camera frame, etc. It seems everyone is doing this on both sides of the Russia-Ukraine war and Israel-Gaza war. Do we even need deepfakes when there's a practically unlimited amount of such video that can easily be cut deceptively, taken out of context, and misattributed to show anything you want?
- blurbleblurble 3y agoBoth candidates in the recent Argentine presidential election used generative AI: https://medium.com/readyai-org/the-dawn-of-a-new-era-artificial-intelligence-takes-charge-in-landmark-election-9cc852530610 https://medium.com/readyai-org/the-dawn-of-a-new-era-artific...