3 ms·

I can imagine a future where it's quite easy to fake real people. By gathering information, pictures and maybe even videos of a person, you might be able to dee

I can imagine a future where it's quite easy to fake real people. By gathering information, pictures and maybe even videos of a person, you might be able to deep fake a credible video of them. It might know their address and use pictures and Streetview material to have them "record" a video from their house. That means that a clever script would be able to figure out who a persons real friends are (that info is easily obtained already today), and create personalised videos from said friends. In such a scenario it might not be the Great Logging off, but it would certainly be a situation where you think "I had breakfast with my friend and he said X to my face, so I can believe it.", but anything online can be considered noise.

dmurray 4y ago
Hard to imagine that there couldn't be any kind of trusted (perhaps encrypted, but not necessarily) communication online. Text conversations are trivial to fake, and WhatsApp could trivially MITM a handful of conversations and tell me my friend said something different and I'd never know. But they have an incentive not to do this at a large scale, because there are benefits of running a worldwide trusted messaging service, and they would fear people would move to alternatives when millions of messages started being adulterated.
mrtksn 4y ago
Certainly this is within the reach of the tech. What I'm afraid of is, this will dull people because the computer models would not have the fidelity of a real person(simply because only small portion of humans thoughts are expressed and even less recorder). Many people will prefer to interact with this shallow model of humans instead of real ones in similar manner of porn replacing real sex. It will create armies of people who have no real skills with working or even interacting with humans. Representing people as avatars and a nickname already created huge issue with perfectly nice people forgetting that they are interacting with real people online, turning into huge jerks. I can imagine how horrible in could become when people are completely disenfranchised from reality.
- irthomasthomas 4y ago
  The precession of simulacra. https://en.m.wikipedia.org/wiki/Simulacra_and_Simulation https://en.m.wikipedia.org/wiki/Simulacra_and_Simulation
moffkalast 4y ago
That's a neat thing I kinda want to do right before dying, just taking all of my chat data I can get my hands on, retraining a chatbot on it and have it become the final version of me that can exist for as long as people want it around (aka pay for the server and gpu instance lol).
blueridge 4y ago
At a previous company, we had a standard "About" page with our names and photos, didn't think anything of it. Fast forward a few years and we discovered a bunch of Russian "businesses" who had used our names and photos on their About page. They were selling all sorts of bogus apps and service contracts. We reached out and sent a kind message and asked them to remove our photos, they responded (and apologized!) and said they would remove the content, but of course that never happened. To this day, when people search for me, they find an old photo and my name associated with a fraudulent company selling shit products and services. On a related note, a few of my friends have taken down their long standing personal sites and blogs for this very reason. A few bad actors took their photos, their About pages, a bunch of their blog posts, and used them as if they were their own—quoting them, tweeting them, referencing them in "their work", etc. One of them got wrapped up in an elaborate hiring scam where someone used his photo, email address, and employment history from LinkedIn and got all the way through an interview process. The whole situation was so jarring that he wiped everything—almost a decade of writing, his LinkedIn profile, his Twitter account, all of it.

dmurray 4y ago

Hard to imagine that there couldn't be any kind of trusted (perhaps encrypted, but not necessarily) communication online. Text conversations are trivial to fake, and WhatsApp could trivially MITM a handful of conversations and tell me my friend said something different and I'd never know. But they have an incentive not to do this at a large scale, because there are benefits of running a worldwide trusted messaging service, and they would fear people would move to alternatives when millions of messages started being adulterated.

mrtksn 4y ago

Certainly this is within the reach of the tech. What I'm afraid of is, this will dull people because the computer models would not have the fidelity of a real person(simply because only small portion of humans thoughts are expressed and even less recorder). Many people will prefer to interact with this shallow model of humans instead of real ones in similar manner of porn replacing real sex. It will create armies of people who have no real skills with working or even interacting with humans. Representing people as avatars and a nickname already created huge issue with perfectly nice people forgetting that they are interacting with real people online, turning into huge jerks. I can imagine how horrible in could become when people are completely disenfranchised from reality.

irthomasthomas 4y ago
The precession of simulacra. https://en.m.wikipedia.org/wiki/Simulacra_and_Simulation https://en.m.wikipedia.org/wiki/Simulacra_and_Simulation

moffkalast 4y ago

That's a neat thing I kinda want to do right before dying, just taking all of my chat data I can get my hands on, retraining a chatbot on it and have it become the final version of me that can exist for as long as people want it around (aka pay for the server and gpu instance lol).

blueridge 4y ago

At a previous company, we had a standard "About" page with our names and photos, didn't think anything of it. Fast forward a few years and we discovered a bunch of Russian "businesses" who had used our names and photos on their About page. They were selling all sorts of bogus apps and service contracts. We reached out and sent a kind message and asked them to remove our photos, they responded (and apologized!) and said they would remove the content, but of course that never happened. To this day, when people search for me, they find an old photo and my name associated with a fraudulent company selling shit products and services. On a related note, a few of my friends have taken down their long standing personal sites and blogs for this very reason. A few bad actors took their photos, their About pages, a bunch of their blog posts, and used them as if they were their own—quoting them, tweeting them, referencing them in "their work", etc. One of them got wrapped up in an elaborate hiring scam where someone used his photo, email address, and employment history from LinkedIn and got all the way through an interview process. The whole situation was so jarring that he wiped everything—almost a decade of writing, his LinkedIn profile, his Twitter account, all of it.