6 ms·

We've been very concerned earlier about what deepfaking a world leader might result in. Still a concern on that, but we can have endless amounts of additional f

We've been very concerned earlier about what deepfaking a world leader might result in. Still a concern on that, but we can have endless amounts of additional fun with realistic deepfaking B- and C-list celebs and all "influencers" who have left enormous trails of audio and video. Picture an adversary setting up a large deepfake campaign involving hundreds or thousands of fakes, esp coordinated with their use of the hundreds or thousands of curated social media profiles that have been raised on a media farm.

mmebane 4y ago
With social media influencers, you don't even have to worry much about the deepfakes glitching - the usage of filters is rampant enough that glitches have been completely normalized.
- treeman79 4y ago
  Had an influencer make me up crap about a her work. Hundreds of people calling her out on it. Her fans did not care. Comments all got buried or deleted. The fans would come up with dumbest possible rebuttals. Basically they liked her she was pretty therefore she was right about everything. And all the easy to verify facts were not important.
  - Dan_Sylveste 4y ago
    Any halfway competent social media management team has enough bots on standby to be able to sweep anything but an absolute stone cold dead-body-in-the-trunk scandal under the rug in seconds. Step 1 of managing any celeb's social media profile is to add 15k of bots to their followers so you can 'forum slide' any criticism away at will.
- tluyben2 4y ago
  There are entire subreddits devoted to how incredibly fake instagram and TikTok people make themselves look with filters so yes, this is already normal with real people. It would not take much.
sva_ 4y ago
You could probably grow a farm of deep fakes on some social media site, talking to each other about peculiar niche things using language models, and once that farm is big enough use it to shift opinions/attack. It's scary how small groups of people, or even an individual could do that.
- ramesh31 4y ago
  >You could probably grow a farm of deep fakes on some social media site, talking to each other about peculiar niche things using language models, and once that farm is big enough use it to shift opinions/attack. It's scary how small groups of people, or even an individual could do that. You've just described half of Twitter's MAUs.
  - pempem 4y ago
    It also feels very like ender's game near the end of the book
- tablespoon 4y ago
  > You could probably grow a farm of deep fakes on some social media site, talking to each other about peculiar niche things using language models, and once that farm is big enough use it to shift opinions/attack. It's scary how small groups of people, or even an individual could do that. Wouldn't that be fairly easy to detect because the accounts would belong to an isolated, tightly-connected cluster?
  - quantified 4y ago
    State actors can design societies with lots of different clusters. It's all in the simulator you design. And a large actor could easily require that its humans engage with members of this society to connect them with humanity.
  - deleted 4y ago
    [deleted]
  - sva_ 4y ago

mmebane 4y ago

With social media influencers, you don't even have to worry much about the deepfakes glitching - the usage of filters is rampant enough that glitches have been completely normalized.

treeman79 4y ago
Had an influencer make me up crap about a her work. Hundreds of people calling her out on it. Her fans did not care. Comments all got buried or deleted. The fans would come up with dumbest possible rebuttals. Basically they liked her she was pretty therefore she was right about everything. And all the easy to verify facts were not important.
- Dan_Sylveste 4y ago
  Any halfway competent social media management team has enough bots on standby to be able to sweep anything but an absolute stone cold dead-body-in-the-trunk scandal under the rug in seconds. Step 1 of managing any celeb's social media profile is to add 15k of bots to their followers so you can 'forum slide' any criticism away at will.
tluyben2 4y ago
There are entire subreddits devoted to how incredibly fake instagram and TikTok people make themselves look with filters so yes, this is already normal with real people. It would not take much.

sva_ 4y ago

You could probably grow a farm of deep fakes on some social media site, talking to each other about peculiar niche things using language models, and once that farm is big enough use it to shift opinions/attack. It's scary how small groups of people, or even an individual could do that.

ramesh31 4y ago
>You could probably grow a farm of deep fakes on some social media site, talking to each other about peculiar niche things using language models, and once that farm is big enough use it to shift opinions/attack. It's scary how small groups of people, or even an individual could do that. You've just described half of Twitter's MAUs.
- pempem 4y ago
  It also feels very like ender's game near the end of the book
tablespoon 4y ago
> You could probably grow a farm of deep fakes on some social media site, talking to each other about peculiar niche things using language models, and once that farm is big enough use it to shift opinions/attack. It's scary how small groups of people, or even an individual could do that. Wouldn't that be fairly easy to detect because the accounts would belong to an isolated, tightly-connected cluster?
- quantified 4y ago
  State actors can design societies with lots of different clusters. It's all in the simulator you design. And a large actor could easily require that its humans engage with members of this society to connect them with humanity.
- deleted 4y ago
  [deleted]
- sva_ 4y ago