9 ms·
No. We've had photo and audio manipulation for many decades now. For a long time now, we've had to separate out what's credible from what's bullshit. Fortunate
by crazygringo 3y ago
No. We've had photo and audio manipulation for many decades now. For a long time now, we've had to separate out what's credible from what's bullshit.
Fortunately, it's pretty simple in real life. We have certain publications and sources we trust, whether they're the NYT or a respected industry blog. We know they take accurate reporting seriously, fire journalists who are caught fabricating things, etc.
If we see a clip on YouTube from the BBC, we can trust it's almost certainly legit. If it's some crazy claim from a rando and you care whether it's real, it's easy to look it up to see if anyone credible has confirmed it.
So no, no worry at all about the past being erased.
- minsc_and_boo 3y agoYep, every time technology shifts, reputation systems shift in response. This goes all the way back to yellow news with newspapers: https://en.wikipedia.org/wiki/Yellow_journalism https://en.wikipedia.org/wiki/Yellow_journalism
- ysleepy 3y agoI don't agree. With ML tools it is possible to make sweeping changes to images and text that are often impossible to detect. combined with the centralisation of most online activities, large players could alter the past. Imagine facebook decides to subtly change every public post and comment to show some particular person or cause in a better light.
- crazygringo 3y agoIf one "large player" like the NYT decides to "alter the past", you can compare with the WaPo or any other newspaper. You can compare with the Internet Archive. You can compare with microfiche. These aren't "impossible to detect", they're trivial to detect if you bother to compare. We have tons of credible archived sources owned by different institutions. And these sources are successful in large part due to their credibility and trustworthiness. It's just not economically rational for any of them to start "altering the past", and if they did, they'd be caught basically immediately and their reputation would be ruined. This isn't an ML/tooling question, it's a question of humans and reputation and economic incentives.
- jononor 3y agoThe suggested large player was Facebook and Facebook posts. Which trustworthy independent sources of authenticity do we have for that? I do not think those you mention reach inside their walled garden?
- crazygringo 3y agoFirst, why would Facebook do that? What economic incentive would there ever be, that would outweigh the loss of trust and reputation hit that would ensue? Second, people take screenshots of Facebook posts all the time. They're everywhere. If you suddenly have a ton of people with timestamped screenshots from their phones that show Facebook has changed content, that's exactly the kind of story journalists will pounce on and verify. The idea that Facebook could or would engage in widespread manipulation of past content and not get caught is just not realistic.
- ysleepy 3y agoYou seem eager to exclude the possibility. Maybe it is improbable, but there now is the technical possibility which was not there before. It is valuable to explore that possibility and maybe even work to prevent such a use. I would be interested in a ledger of cryptographically signed records of important public information such as newspapers, government communication and intellectual discourse. Your argument that large social media will behave rationally is not backed up by reality. Consider Musk and Twitter.
- oceanplexian 3y ago> If one "large player" like the NYT decides to "alter the past", you can compare with the WaPo or any other newspaper. You can compare with the Internet Archive. You can compare with microfiche. These aren't "impossible to detect", they're trivial to detect if you bother to compare. Detection doesn't really matter, because people are too lazy to validate the facts, and reporters are not interested in reporting them. AI is simply another tool to manipulate people, like Wikipedia, Reddit.com, Twitter, or any other BS psuedo-authority. Think someone will actually crack open a book to prove the AI wrong? Not a chance.
- amelius 3y ago> We've had photo and audio manipulation for many decades now. For a long time now, we've had to separate out what's credible from what's bullshit. The difference is that the floodgates are being opened.
- conductr 3y agoAt a time when “people” seem easily manipulated and focused on their fully believing their personal feeds of curated outrage. They often don’t apply the screens/filters they should be because of the apparent social proofs, trust, and biases they have with the content. Contemporary journalists hardly do any fact/source checks as it is. So they’ll begin reporting on some of this, giving it further credibility and it’s just a downward spiral. So, more of the same, yay!
- crazygringo 3y agoIt doesn't matter though. Most of the internet is already probably mostly SEO blogspam, just like spam e-mail already outweighs legitimate e-mail for a lot of (most?) people. But nobody cares because it gets filtered out in the ways people actually navigate. We have lots of tools to fight spam, and there's no reason to believe they won't continue to evolve and work well.
- probablynish 3y agoSeems like it might now become much easier to post a clip on YouTube that looks like an authentic BBC clip, logo and all. If generative AI gets that good, how will you be able to tell whether a particular piece of media comes from a trusted source? Might not be possible on platforms - only if it's posted on a trusted domain.
- crazygringo 3y agoEasy, is it on the official BBC YouTube channel or not? That's the entire point of having trusted sources. Regular people can post whatever fake things they want on their own accounts; they can't post to the BBC's YouTube channel or to the NYT's website.
- strikelaserclaw 3y agoMost people these days interact with news through comments, if comments looks legit, a lot of people assume the source is legit. Imagine a world in which a fake video has the bbc logo on it and ai generated comments act if they are discussing the video but they subtly manipulate, like 60% of the comments advocate a certain view point and 40% are random memes, advocate against it etc... The average person would easily be fooled.
- oceanplexian 3y agoYou basically described Reddit. Don't even need an AI, all you need is moderator powers and a bunch of impressionable young people.
- pessimizer 3y ago> We've had photo and audio manipulation for many decades now. We haven't been able to generate 1,000 different forged variants of the same speech in a day before. > We have certain publications and sources we trust, whether they're the NYT or a respected industry blog. We can't even be sure that most of these aren't changing old stories, unless we notice and check archive.org, and they haven't had them deleted from the archive. The NYT has blockchain verification, but the reason nobody else does is because no one else wants to. They want to be free to change old stories.
- crazygringo 3y ago> but the reason nobody else does is because no one else wants to. They want to be free to change old stories. You're wildly assuming a motive with zero evidence. No, the reason companies aren't building blockchain verification of their stories is simply because it's expensive and complicated to do, for literally zero commercial benefit. Archive.org already will prove any difference to you, and it's much easier to use/verify than any blockchain technology.
- bottlepalm 3y agoIf I have a random picture, video, text - it's not easy at all to verify its authenticity. Hopefully a media organization has it, but even then are there any services I can use to validate? Definitely not family/personal media, any media that wasn't reported on by a large organization with the ability to manage large archives of data. I'm saying this is going to become increasingly important fast, and we may miss the window where now almost everything not properly indexed by a large media organization is invalidated as there is no way to verify it. I have a picture of Frank Sinatra at Disney World riding the tea cups. Who is the Frank Sinatra media authority that can tell me if this ever happened or not? A very small example to extrapolate from. It's going to get worse when everyone can create audio/video/pictures/text of anything they can dream. The past may very well become a fictional dream, mythology, most of it impossible to verify.