5 ms·

Most people think deepfake will be something massive like this. I suspect it's going to be very subtle. With a few words and phrases changed. Imagine a po

Most people think deepfake will be something massive like this. I suspect it's going to be very subtle. With a few words and phrases changed. Imagine a politician saying, "I'm for low taxes" and it's changed to "I'm for high taxes" Just one word that changes everything and has a big enough impact.

mlb_hn 7y ago
Or imagine it at scale. It seems there are two uses of deepfake which have separate effects: 1) High profile low volume content that trends (article) 2) Low profile high volume content spam (your point) The second one seems like a much harder problem than the first (but both matter). Everyone already gets dozens of spam/phishing emails and links a day and not much has been done about it. I have no idea what the impact of deepfakes on the latter even looks like.
shostack 7y ago
It isn't just the ability to change a message subtly and play both sides, it is the ability to deploy that at scale to highly siloed and divided audiences. This happens to be a known tactic of Russian active measures btw. We've seen the impact of that politically, but I worry what will come during an actual large-scale military conflict when the battlefield very much becomes digital and attempting to subvert civilians to the cause.
undersuit 7y ago
As computing power grows these attacks will become something that can be performed in real-time on a single target. You could hack a CEO to introduce literal fake news that they would then act on, or change the instructions on a bomb-building video so that a "required ingredient" is exclusively sourced from a local store with direct contact with the FBI. Did your friend on Skype really tell you to meet them on Main and Broadway at 4PM?
6gvONxR4sf7o 7y ago
Or even more subtle. A tired looking politician says "I'm for, um, low taxes" and it's changed to a slightly more handsome version saying slightly more charismatically, "I'm for low taxes."
johannes1234321 7y ago
A single word won't work, if you have any context. A thing which works to some degree is some more subtle editing (see the recent case of the slow Pelossi video) making people appear drunk or sick can be powerful.

mlb_hn 7y ago

Or imagine it at scale. It seems there are two uses of deepfake which have separate effects: 1) High profile low volume content that trends (article) 2) Low profile high volume content spam (your point) The second one seems like a much harder problem than the first (but both matter). Everyone already gets dozens of spam/phishing emails and links a day and not much has been done about it. I have no idea what the impact of deepfakes on the latter even looks like.

shostack 7y ago

It isn't just the ability to change a message subtly and play both sides, it is the ability to deploy that at scale to highly siloed and divided audiences. This happens to be a known tactic of Russian active measures btw. We've seen the impact of that politically, but I worry what will come during an actual large-scale military conflict when the battlefield very much becomes digital and attempting to subvert civilians to the cause.

undersuit 7y ago

As computing power grows these attacks will become something that can be performed in real-time on a single target. You could hack a CEO to introduce literal fake news that they would then act on, or change the instructions on a bomb-building video so that a "required ingredient" is exclusively sourced from a local store with direct contact with the FBI. Did your friend on Skype really tell you to meet them on Main and Broadway at 4PM?

6gvONxR4sf7o 7y ago

Or even more subtle. A tired looking politician says "I'm for, um, low taxes" and it's changed to a slightly more handsome version saying slightly more charismatically, "I'm for low taxes."

johannes1234321 7y ago

A single word won't work, if you have any context. A thing which works to some degree is some more subtle editing (see the recent case of the slow Pelossi video) making people appear drunk or sick can be powerful.