4 ms·
I fear that we're barrelling fast toward a future when nobody can trust anything at all anymore, label or not.
by JohnFen 3y ago
I fear that we're barrelling fast toward a future when nobody can trust anything at all anymore, label or not.
- nonethewiser 3y agoWe have to expect people to think for themselves. People are flawed and will be deceived but trying to centralize critical thinking will have far more disastrous results. Its always been that way. Im not saying Youtube shouldn’t have AI labels. Im saying we shouldn’t assume they’re reliable.
- Barrin92 3y ago>but trying to centralize critical thinking will have far more disastrous results No. Having sources of trust is the basis of managing complexity. When you turned the tap water on and bought a piece of meat at the butcher you didn't yourself verify whether its healthy right? You trust the medicine you buy contains exactly what is says on the label and didn't take a chemistry class. That's centralized trust. You rely on it ten thousand times a day implicitly. There need to be measures to make sure media content is trustworthy, because the smartest person on the earth doesn't have enough resources to critically judge 1% of what they're exposed to every day. It is simply a question of information processing. It's a mathematical necessity. Information that is collectively processed constantly goes up, individiual bandwith does not, therefore you need more division of labor, efficieny and higher forms of social organisation.
- nonethewiser 3y ago> Having sources of trust is the basis of managing complexity. This is a false equivalence that I’ve already addressed. > When you turned the tap water on and bought a piece of meat at the butcher you didn't yourself verify whether its healthy right? To a degree, yeah, you do check. Especially when you get it from somewhere with prior problems. And if you see something off you check further and adjust accordingly. Why resort to anology? Should we blindly trust YouTube to judge whats true or not? I stated that labeling videos is fine but what’s not fine is blindly trusting it. Additionally, comparing to meat dispenses with all the controversy because food safety is a comparatively objective standard. Compare, “is this steak safe to eat or not?” To “is this speech safe to hear or not?”
- xarope 3y agoI'm probably paraphrasing Schneier (and getting it wrong), but getting water from the tap and having it polluted or poisonous, has legal and criminal consequences. Similarly getting meat from a butcher and having it tainted. Right now, getting videos which are completely AI/deepfaked to misrepresent, are not subject to the same consequences, simply because either #1 people can't be bothered, #2 are too busy spreading it via social media, or #3 have no idea how to sue the party on the other side. And therein lies the danger, as with social media, of the lack of consequences (and hence the popularity of swatting, pretexting etc)
- knowaveragejoe 3y agoThis bodes well for autocracies and would-be autocrats. It's the logical extreme of what they've been trying to do on social media over the last decade or so. https://en.wikipedia.org/wiki/Firehose_of_falsehood https://en.wikipedia.org/wiki/Firehose_of_falsehood
- Gigachad 3y agoIt just goes back to trusting the source. If 5 media orgs post different recordings of the same political speech, you can be reasonably sure it actually happened, or at least several orders of magnitude more sure than if it's one blurry video from a no name account.
- pojzon 3y agoAnd then you learn all of those media orgs are owned by the same billionare. There will be no way to say something is true beside seeing it with own eyes.
- BlueTemplar 3y agoThen that's a single media org.
- sverhagen 3y agoI was immediately thinking that the #AI labels are going to give people a false sense of trust, so that when someone posts a good-enough fake without the #AI label, it can do damage if it goes viral before it gets taken down for the mislabeling. (Kudos for the effort, though, YouTube.)
- Cthulhu_ 3y agoBehind the scenes, I'm 99% confident that Google has deployed AI detection tools and will monitor for it. That said, unless all the AI generators agree on a way to add an unalterable marker that something is generated, at one point it may become undetectable. May.
- JohnFen 3y agoI'm not aware of any AI detection tools that are actually effective enough to be interesting. Perhaps Google has some super-secret method that works, but I rather doubt it. If they did, I think they'd be trumpeting it from the hilltops.
- Cthulhu_ 3y agoAnd this isn't new. A fad in films in the 90's was hyper-realistic masks on the one side, and make-up and prosthetics artists on the other, making people look like other people. Faking things is not new, and you've always been right to mistrust what you see on the internet. "AI" technology has made it easy, convenient, accessible and affordable to more people though, beforehand you needed image/video editing skills and software, a good voice mod, be a good (voice) actor, etc.
- JohnFen 3y ago> you've always been right to mistrust what you see on the internet. But these tools make deception easier and cheaper, meaning it will become much more common. Also, it's not just "on the internet". The trust problem this brings up applies to everything.
- electrondood 3y agoThis deeply worries me. A post-truth society loses it's ability to participate in democracy, becomes a low-trust society, the population falls into learned helplessness and apathy ("who can even know what's true any more?") Look at Russian society for a sneak preview if we don't get this right.