5 ms·

I think we’re just getting started, with fake images and videos. I suspect that people will be killed, because of outrage over fake stuff. Before the Ukraine i

I think we’re just getting started, with fake images and videos. I suspect that people will be killed, because of outrage over fake stuff. Before the Ukraine invasion, some of the folks in Donbas made a fake bomb, complete with corpses from a morgue (with autopsy scars)[0]. That didn’t require any AI at all. We can expect videos of unpopular minorities, doing horrible things, politicians saying stuff they never said, and evidence submitted to trial, that was completely made from whole cloth. It’s gonna suck. [0] https://www.bellingcat.com/news/2022/02/28/exploiting-cadavers-and-faked-ieds-experts-debunk-staged-pre-war-provocation-in-the-donbas/ https://www.bellingcat.com/news/2022/02/28/exploiting-cadave...

ineedasername 11mo ago
So far, I see the most concern about this sort of thing from people who came of age around or after Web 2.0 hit, at a time when even a good photoshop wasn’t too hard to place as fake. Those I know who lived through this issue when digital editing really became cheap seem to be more sanguine about it, while the younger generation on the opposite side side is some combination “whatever” or frustrated but accept that yet another of countless weird things has invade a reality that was never quite right to begin with. The folks in between, I’d say about the 20 years from age 20 to 40, are the most annoyed though. The eye of the storm on the way to proving that cyberpunk lacked the required imagination to properly calibrate our sense of when things were going to really get insane.
- soneil 11mo ago
  In my family it's the other way around - it's the people that used to tell us not to talk to strangers on the internet, and not to believe everything we see on the internet, who are now doing precisely that.
oefrha 11mo ago
> We can expect videos of unpopular minorities, doing horrible things Expect? You can post a random image of an unpopular minority, add some caption saying they did horrible things, that is not reflected in the image at all, and tons of people will pile on. Don’t even need a fake video.
- littlestymaar 11mo ago
  In fact, this is already happening on a daily basis. IA ain't the problem here, so called social media are.
  - tormeh 11mo ago
    Well, some news organizations are more than willing to spread fake news as well, so it's hardly limited to social media. I think it's just in-group vs out-group mentality, and a need to hate.
  - markdown 11mo ago
    It was not happening on a daily basis on Twitter before Elon Musk. The endless flow of racism and bigotry on that website is a choice. It's convenient to blame the amorphous thing "social media" instead of the actual people responsible. There are only a handful of them: Elon Musk, Mark Zuckerberg, etc. And stopping it is simple. It's a choice.
    - immibis 11mo ago
      It was, but it wasn't pushed into everyone's filter bubble.
- yakshaving_jgt 11mo ago
  For some reason this hurts worse. I was listening to James O’Brien on LBC, and [IIRC] he said he was serving jury duty with a woman who was convinced that Volodymyr Zelenskyy had spent hundreds of million of dollars on a super-yacht. He asked if she had any evidence for that claim, and she produced a picture of a boat. He said “That’s just a picture of a boat.”
  - groestl 11mo ago
    Ironically, there is no evidence that woman ever said that.
    - 11mo ago
huflungdung 11mo ago
[dead]
intended 11mo ago
Oh heck yes. One India focused study that I saw, introduced me to the term Cheap Fakes. Another report studied how genAI made phishing pipelines more efficient, allowing profitable targeting of groups who hitherto were too poor to be targetted. So on one end you have large scale pollution of the information commons, and on the other end we are now creating predator pipelines to generate content with all the efficiency of our vaunted AI productivity. Its creating a dark forest for normal people to navigate, driving more government efforts to bring control. This in turn puts this in conflict with freedom of speech and expression while dovetailing nicely with authoritarian tendencies. Yes, Its heartening to hear all the people who find productivity gains from AI, but in totality it feels like we got our wishes granted by the Evil Genie.
- parineum 11mo ago
  > One India focused study that I saw, introduced me to the term Cheap Fakes Wasn't that term entirely invented by the Democratic party to dismiss videos of Biden's "senior moments"? I'm curious if the term predates that or maybe you're not in the US?
  - intended 11mo ago
    I heard it this year, but its a term that once you hear it, you "get it". Definitely not an India only thing.
  - IAmBroom 11mo ago
    It seems to have been originated by two authors of a book on the 2024 election, where manipulative fake and misleading videos by the GOP were a widespread issue. Not sure why you're trying to pretend that the idea of fake videos is some anti-GOP conspiracy.
    - parineum 11mo ago
      Specifically the term "Cheap fakes" I have seen applied to genuine videos as well as doctored videos, all in response to videos of Biden though.
raverbashing 11mo ago
> We can expect videos of unpopular minorities, doing horrible things While manipulation of photos exist, and real photos misattributed are very common, for the most part a lot of that does happen as well. And some people are too quick to ignore or gloss over it
- nemomarx 11mo ago
  I'm sure this will be exactly the popular attitude - yes, the evidence and videos people see and form emotional reactions based on are fake, but the problem is real and so we should let it slide and just assume something exactly like the AI video happened anyway.
krapp 11mo ago
>We can expect videos of unpopular minorities, doing horrible things, politicians saying stuff they never said, and evidence submitted to trial, that was completely made from whole cloth. AI videos of unpopular minorities already comprise an entire genre and AI political misinformation is already mainstream. I'm pretty sure every video of Donald Trump released by the WH is AI generated, to make him look less senile and frail than he really is. We're already there.
uyzstvqs 11mo ago
People were able to make very realistic fakes of anything 10-20 years ago, using basic tools. Just ask the UFO nuts or the NSFW media enthusiasts. And like what you mentioned, staged scenes have become somewhat common as well, including before the internet. We can expect more of the same. Random unverified photo and video should not be trusted, not in 2005, not in 2015, and not today. I believe that this "everything was fine but it's going to get really bad" narrative is just yet another attempt at regulatory capture, to outlaw open-source AI. This entire fake bridge collapse might very well be a false flag to scare senile regulators.
- deleted 11mo ago
  [deleted]
- 1718627440 11mo ago
  Motivated people (nation states) were able to do this even hundred years ago. The issue is simply that most people didn't did that.

ineedasername 11mo ago

So far, I see the most concern about this sort of thing from people who came of age around or after Web 2.0 hit, at a time when even a good photoshop wasn’t too hard to place as fake. Those I know who lived through this issue when digital editing really became cheap seem to be more sanguine about it, while the younger generation on the opposite side side is some combination “whatever” or frustrated but accept that yet another of countless weird things has invade a reality that was never quite right to begin with. The folks in between, I’d say about the 20 years from age 20 to 40, are the most annoyed though. The eye of the storm on the way to proving that cyberpunk lacked the required imagination to properly calibrate our sense of when things were going to really get insane.

soneil 11mo ago
In my family it's the other way around - it's the people that used to tell us not to talk to strangers on the internet, and not to believe everything we see on the internet, who are now doing precisely that.

oefrha 11mo ago

> We can expect videos of unpopular minorities, doing horrible things Expect? You can post a random image of an unpopular minority, add some caption saying they did horrible things, that is not reflected in the image at all, and tons of people will pile on. Don’t even need a fake video.

littlestymaar 11mo ago
In fact, this is already happening on a daily basis. IA ain't the problem here, so called social media are.
- tormeh 11mo ago
  Well, some news organizations are more than willing to spread fake news as well, so it's hardly limited to social media. I think it's just in-group vs out-group mentality, and a need to hate.
- markdown 11mo ago
  It was not happening on a daily basis on Twitter before Elon Musk. The endless flow of racism and bigotry on that website is a choice. It's convenient to blame the amorphous thing "social media" instead of the actual people responsible. There are only a handful of them: Elon Musk, Mark Zuckerberg, etc. And stopping it is simple. It's a choice.
  - immibis 11mo ago
    It was, but it wasn't pushed into everyone's filter bubble.
yakshaving_jgt 11mo ago
For some reason this hurts worse. I was listening to James O’Brien on LBC, and [IIRC] he said he was serving jury duty with a woman who was convinced that Volodymyr Zelenskyy had spent hundreds of million of dollars on a super-yacht. He asked if she had any evidence for that claim, and she produced a picture of a boat. He said “That’s just a picture of a boat.”
- groestl 11mo ago
  Ironically, there is no evidence that woman ever said that.
  - 11mo ago

huflungdung 11mo ago

[dead]

intended 11mo ago

Oh heck yes. One India focused study that I saw, introduced me to the term Cheap Fakes. Another report studied how genAI made phishing pipelines more efficient, allowing profitable targeting of groups who hitherto were too poor to be targetted. So on one end you have large scale pollution of the information commons, and on the other end we are now creating predator pipelines to generate content with all the efficiency of our vaunted AI productivity. Its creating a dark forest for normal people to navigate, driving more government efforts to bring control. This in turn puts this in conflict with freedom of speech and expression while dovetailing nicely with authoritarian tendencies. Yes, Its heartening to hear all the people who find productivity gains from AI, but in totality it feels like we got our wishes granted by the Evil Genie.

parineum 11mo ago
> One India focused study that I saw, introduced me to the term Cheap Fakes Wasn't that term entirely invented by the Democratic party to dismiss videos of Biden's "senior moments"? I'm curious if the term predates that or maybe you're not in the US?
- intended 11mo ago
  I heard it this year, but its a term that once you hear it, you "get it". Definitely not an India only thing.
- IAmBroom 11mo ago
  It seems to have been originated by two authors of a book on the 2024 election, where manipulative fake and misleading videos by the GOP were a widespread issue. Not sure why you're trying to pretend that the idea of fake videos is some anti-GOP conspiracy.
  - parineum 11mo ago
    Specifically the term "Cheap fakes" I have seen applied to genuine videos as well as doctored videos, all in response to videos of Biden though.

raverbashing 11mo ago

> We can expect videos of unpopular minorities, doing horrible things While manipulation of photos exist, and real photos misattributed are very common, for the most part a lot of that does happen as well. And some people are too quick to ignore or gloss over it

nemomarx 11mo ago
I'm sure this will be exactly the popular attitude - yes, the evidence and videos people see and form emotional reactions based on are fake, but the problem is real and so we should let it slide and just assume something exactly like the AI video happened anyway.

krapp 11mo ago

>We can expect videos of unpopular minorities, doing horrible things, politicians saying stuff they never said, and evidence submitted to trial, that was completely made from whole cloth. AI videos of unpopular minorities already comprise an entire genre and AI political misinformation is already mainstream. I'm pretty sure every video of Donald Trump released by the WH is AI generated, to make him look less senile and frail than he really is. We're already there.

uyzstvqs 11mo ago

People were able to make very realistic fakes of anything 10-20 years ago, using basic tools. Just ask the UFO nuts or the NSFW media enthusiasts. And like what you mentioned, staged scenes have become somewhat common as well, including before the internet. We can expect more of the same. Random unverified photo and video should not be trusted, not in 2005, not in 2015, and not today. I believe that this "everything was fine but it's going to get really bad" narrative is just yet another attempt at regulatory capture, to outlaw open-source AI. This entire fake bridge collapse might very well be a false flag to scare senile regulators.

deleted 11mo ago
[deleted]
1718627440 11mo ago
Motivated people (nation states) were able to do this even hundred years ago. The issue is simply that most people didn't did that.