3 ms·

Your country might not have lynching mobs, but you can't deny there are certain taboo topics in your society also, certain slurs and other opinions which would

Your country might not have lynching mobs, but you can't deny there are certain taboo topics in your society also, certain slurs and other opinions which would take you ages to clense and even then never fully. If an AI fake-porn of some ordinary person involving a minor was unleashed, think of the utter shame and horror they would be treated by people for the rest of their lives, even if it were proven false. No one would believe them, work with them, hire them, rent them, they would wish they had been lynched instead of the life they live.

roenxi 2y ago
But mob formation and mass social shaming on little evidence already happens without AI and it isn't clear why AI would make it worse. If it gets so easy to create fake videos that'll just muddy the waters and people would trust rumour less, not form mobs more. It happens once, then some wag creates videos of all the mob leaders blaspheming or whatever. Undermines the idea that the videos are the root cause.
- ryzvonusef 2y ago
  You are giving too much credence to the analytical capabilites to a lynch mob, and you are underestimating how much AI lowers the barrier for creating realistic 'proof' for incitement. Also there are no mob 'leaders'. These are everyday folks, these are you and me and my neighbours. A student pissed at a teacher could create a fake AI video of his teacher at night, and wake up to no pesky teacher and feel no remorse over what happened while he slept. The student was not a mob leader, just some dumbass who was angry at their teacher for giving bad grades, and had access to simple AI tools (soon available online for a trivial fee, if not free). ____ Be honest, are you 100% sure of the status of that facebook account you deleted in 2018? Zuck never deleted it, that content is still there to be mined and abused. Also not that hard to just log in to the damn thing and post something spicy. I don't remember if old posts can be edited in FB, cause that would allow the person to really gild the lily.
- benterix 2y ago
  > people would trust rumour less, not form mobs more I believe you are right. When the first unbelievable clips appeared on Facebook (where the most gullible people are), you could see the old ladies cheering "oh how wonderful! where did you film that?" Now in the comments section you will mostly see people saying "sheesh, stop polluting my feed with these fake AI-generated spam". Don't get me wrong, many people still fall for them, but the tendency seems clear - after all, we managed to survive because of learning.
- forgetfreeman 2y ago
  I feel like the Bullshit Asymmetry Principle is involved here. If the bar is lowered to the point where it takes less energy to generate inflammatory video "evidence" than it does to debunk it the shitheads win. I feel like we can all agree that AI has the potential to lower that bar.
nkrisc 2y ago
Yes, you’re right. That’s why the problem is the lynch mobs. If there was no AI, people would find another way to sic the mob on someone. I’m sure it’s already happened countless times without AI. Mobs aren’t known for the rational behavior and respect of the rule of law.
- ryzvonusef 2y ago
  I was simply explaining my personal fears regarding AI given that lynch mobs exist in my country; the lesson you should have taken from that was not about lynch mobs, but to analyse how AI might affect YOU in your particular environment. Remember the post is about cloning a youtuber's voice using AI; most people were thinking of the copywrite aspect of it, but I wanted to share with people what my fear was. My fears are, things are already bad w.r.t lynch mobs before AI, after AI things will only get worse with fake but realistic sounding voice notes etc. That's my fear, doesn't have to be yours. You don't have lynch mobs (hopefully) but surely you can think of other problems that a fake AI image/audio/video can cause, and just low the barrier is, and just how good the tools are.
  - nkrisc 2y ago
    I don’t disagree that AI could exacerbate the issue, in fact I agree. But anything could potentially do so. Instant messaging likely also made the problem worse as a call to form a mob can reach many people much faster than before. The time from inciting incident to mob action is greatly compressed because of instant messaging. It’s fundamentally a societal issue, not a technological one. Yes, it’s scary what effect AI could have on lynch mobs, because lynch mobs are scary.
  - nuancebydefault 2y ago
    Maybe it's because I have no knowledge of lynch mobs in my country but I find that fear is a bad adviser. I think currently there is no way back in AI development. I read Microsoft is getting a failed nuclear reactor repaired to power the power hungry AI. The only way forward is making sure most people know that digital content can be easily faked. If you hand out good faker tools for free, it will happen faster
t0bia_s 2y ago
Next or next next generation would be used to it. Digital content would be consumed differently, with automatical scepticism or so... Remember when people believed that camera took our soul when we are caotured on image?

roenxi 2y ago

But mob formation and mass social shaming on little evidence already happens without AI and it isn't clear why AI would make it worse. If it gets so easy to create fake videos that'll just muddy the waters and people would trust rumour less, not form mobs more. It happens once, then some wag creates videos of all the mob leaders blaspheming or whatever. Undermines the idea that the videos are the root cause.

ryzvonusef 2y ago
You are giving too much credence to the analytical capabilites to a lynch mob, and you are underestimating how much AI lowers the barrier for creating realistic 'proof' for incitement. Also there are no mob 'leaders'. These are everyday folks, these are you and me and my neighbours. A student pissed at a teacher could create a fake AI video of his teacher at night, and wake up to no pesky teacher and feel no remorse over what happened while he slept. The student was not a mob leader, just some dumbass who was angry at their teacher for giving bad grades, and had access to simple AI tools (soon available online for a trivial fee, if not free). ____ Be honest, are you 100% sure of the status of that facebook account you deleted in 2018? Zuck never deleted it, that content is still there to be mined and abused. Also not that hard to just log in to the damn thing and post something spicy. I don't remember if old posts can be edited in FB, cause that would allow the person to really gild the lily.
benterix 2y ago
> people would trust rumour less, not form mobs more I believe you are right. When the first unbelievable clips appeared on Facebook (where the most gullible people are), you could see the old ladies cheering "oh how wonderful! where did you film that?" Now in the comments section you will mostly see people saying "sheesh, stop polluting my feed with these fake AI-generated spam". Don't get me wrong, many people still fall for them, but the tendency seems clear - after all, we managed to survive because of learning.
forgetfreeman 2y ago
I feel like the Bullshit Asymmetry Principle is involved here. If the bar is lowered to the point where it takes less energy to generate inflammatory video "evidence" than it does to debunk it the shitheads win. I feel like we can all agree that AI has the potential to lower that bar.

nkrisc 2y ago

Yes, you’re right. That’s why the problem is the lynch mobs. If there was no AI, people would find another way to sic the mob on someone. I’m sure it’s already happened countless times without AI. Mobs aren’t known for the rational behavior and respect of the rule of law.

ryzvonusef 2y ago
I was simply explaining my personal fears regarding AI given that lynch mobs exist in my country; the lesson you should have taken from that was not about lynch mobs, but to analyse how AI might affect YOU in your particular environment. Remember the post is about cloning a youtuber's voice using AI; most people were thinking of the copywrite aspect of it, but I wanted to share with people what my fear was. My fears are, things are already bad w.r.t lynch mobs before AI, after AI things will only get worse with fake but realistic sounding voice notes etc. That's my fear, doesn't have to be yours. You don't have lynch mobs (hopefully) but surely you can think of other problems that a fake AI image/audio/video can cause, and just low the barrier is, and just how good the tools are.
- nkrisc 2y ago
  I don’t disagree that AI could exacerbate the issue, in fact I agree. But anything could potentially do so. Instant messaging likely also made the problem worse as a call to form a mob can reach many people much faster than before. The time from inciting incident to mob action is greatly compressed because of instant messaging. It’s fundamentally a societal issue, not a technological one. Yes, it’s scary what effect AI could have on lynch mobs, because lynch mobs are scary.
- nuancebydefault 2y ago
  Maybe it's because I have no knowledge of lynch mobs in my country but I find that fear is a bad adviser. I think currently there is no way back in AI development. I read Microsoft is getting a failed nuclear reactor repaired to power the power hungry AI. The only way forward is making sure most people know that digital content can be easily faked. If you hand out good faker tools for free, it will happen faster

t0bia_s 2y ago

Next or next next generation would be used to it. Digital content would be consumed differently, with automatical scepticism or so... Remember when people believed that camera took our soul when we are caotured on image?