3 ms·

Why do we keep thinking that people will wise up to AI-generated content just because it'll eventually be mass-produced and anyone can do it? Anyone can write

Why do we keep thinking that people will wise up to AI-generated content just because it'll eventually be mass-produced and anyone can do it? Anyone can write absolutely anything with little check and balance on substance, and MILLIONS still believe tabloids and headlines. We've been able to reliably edit photos/video/film for 80 years with an exponential increase in its efficiency within the last 30 - and we still have millions that would take a photo or video's substance at face-value.

solumunus 3y ago
You say that but I’ve yet to see an AI deep fake have any real impact so far. At least in the west, the political ones I’ve seen really haven’t got much traction and were quickly dismissed by the mainstream. Sure, there will always be idiots on the fringe who will believe anything that aligns with their current beliefs, there’s little we can do about that, but so far I’m surprised there hasn’t been an AI deepfake that didn’t fizzle within days. I guess we’re early in the game, so time will tell.
- timeon 3y ago
  Small country, but it has already started: https://www.wired.com/story/slovakias-election-deepfakes-show-ai-is-a-danger-to-democracy/ https://www.wired.com/story/slovakias-election-deepfakes-sho... It was shared on social media just before elections during 'moratorium' [0]. There was no time or place to dismiss it by mainstream. [0] https://en.wikipedia.org/wiki/Election_silence https://en.wikipedia.org/wiki/Election_silence
- defrost 3y ago
  Many people have been taken in by "famous billionaire endorses bullshit investment" deepfakes, whether it's Bill Gates, Elon Musk, Warren Buffett, or Australia's Twiggy Forrest, Gina Rinehart etc. The scams are real, the victims are real, it's in the global "west" and sorely under reported and the conveyors (Facebook, Twitter, etc) have washed their hands of dealing with it: eg. Forrest's Facebook fight dropped by Australian prosecutors https://www.watoday.com.au/national/western-australia/forrest-s-fight-against-facebook-over-as-case-dropped-by-prosecutors-20240412-p5fje7.html https://www.watoday.com.au/national/western-australia/forres... Andrew Forrest’s legal battle to hold social media giant Meta to account over the proliferation of scam ads using his likeness on Facebook has been dealt a major blow. Australian victim of fraud syndicate advertising on Facebook on a mission to stop others being burned https://www.abc.net.au/news/2024-04-15/australians-falling-for-facebook-fake-ads-online-trading-scams/103640678 https://www.abc.net.au/news/2024-04-15/australians-falling-f... The realism of deepfake video with real known public figures apparently endorsing investments as "safe" is another level past Nigerian prince scams.
jimbob45 3y ago
Robocalls aren’t effective anymore. Emails don’t do much except once in a great while. Mail hasn’t worked since the 80s. I have to imagine IM clients will lose their effectiveness for scamming the same as all the others.
- brnt 3y ago
  Cant tell if sarcasm or... All of those scams work perfectly fine, that's what they're still around. Money lost through scams is only increasing; it's a growth market.
- HaZeust 3y ago
  You are confused. Robocall scams are still a multi-billion dollar market, capping at an estimated $50b in damages in 2023. [1] 1- https://time.com/6513036/robocalls-government-action/ https://time.com/6513036/robocalls-government-action/

solumunus 3y ago

You say that but I’ve yet to see an AI deep fake have any real impact so far. At least in the west, the political ones I’ve seen really haven’t got much traction and were quickly dismissed by the mainstream. Sure, there will always be idiots on the fringe who will believe anything that aligns with their current beliefs, there’s little we can do about that, but so far I’m surprised there hasn’t been an AI deepfake that didn’t fizzle within days. I guess we’re early in the game, so time will tell.

timeon 3y ago
Small country, but it has already started: https://www.wired.com/story/slovakias-election-deepfakes-show-ai-is-a-danger-to-democracy/ https://www.wired.com/story/slovakias-election-deepfakes-sho... It was shared on social media just before elections during 'moratorium' [0]. There was no time or place to dismiss it by mainstream. [0] https://en.wikipedia.org/wiki/Election_silence https://en.wikipedia.org/wiki/Election_silence
defrost 3y ago
Many people have been taken in by "famous billionaire endorses bullshit investment" deepfakes, whether it's Bill Gates, Elon Musk, Warren Buffett, or Australia's Twiggy Forrest, Gina Rinehart etc. The scams are real, the victims are real, it's in the global "west" and sorely under reported and the conveyors (Facebook, Twitter, etc) have washed their hands of dealing with it: eg. Forrest's Facebook fight dropped by Australian prosecutors https://www.watoday.com.au/national/western-australia/forrest-s-fight-against-facebook-over-as-case-dropped-by-prosecutors-20240412-p5fje7.html https://www.watoday.com.au/national/western-australia/forres... Andrew Forrest’s legal battle to hold social media giant Meta to account over the proliferation of scam ads using his likeness on Facebook has been dealt a major blow. Australian victim of fraud syndicate advertising on Facebook on a mission to stop others being burned https://www.abc.net.au/news/2024-04-15/australians-falling-for-facebook-fake-ads-online-trading-scams/103640678 https://www.abc.net.au/news/2024-04-15/australians-falling-f... The realism of deepfake video with real known public figures apparently endorsing investments as "safe" is another level past Nigerian prince scams.

jimbob45 3y ago

Robocalls aren’t effective anymore. Emails don’t do much except once in a great while. Mail hasn’t worked since the 80s. I have to imagine IM clients will lose their effectiveness for scamming the same as all the others.

brnt 3y ago
Cant tell if sarcasm or... All of those scams work perfectly fine, that's what they're still around. Money lost through scams is only increasing; it's a growth market.
HaZeust 3y ago
You are confused. Robocall scams are still a multi-billion dollar market, capping at an estimated $50b in damages in 2023. [1] 1- https://time.com/6513036/robocalls-government-action/ https://time.com/6513036/robocalls-government-action/