4 ms·

(..) and that people are just like "well I guess kids now have to worry about classmates making photo realistic depictions of them performing sex acts" is so ho

(..) and that people are just like "well I guess kids now have to worry about classmates making photo realistic depictions of them performing sex acts" is so horrifying. You talk of punishment in the context of physical harm (fist vs. face), while deepfakes concern mental distress at worst. 2nd order effects like reputation damage, lost income etc can be adressed by lawyers. Yes mental distress can be severe to some people. Or (for example) cause a group of people to harass someone. But a) such harassment is a separate act from posting a deepfake. And b) If deepfake postings happen often enough, it kinda takes the sting out. Few people today would be deeply disturbed if someone posts their head shopped onto a pornstar's body. That's easy enough that anyone can do it, it's been done many times, so the newsworthiness / shock value is gone. If you know the victim in person, you'd probably be able to tell whether some video is fake or not. Or ask that person. If victim is a random stranger & deepfake disappears into the 'internet background noise', who cares. Either way, when creating a deepfake is easy enough, it simultaneously grants a victim plausible deniability. So ehm... "horrifying" is too strong a word imho. Try "annoying", "bad taste" or "disrespectful". Punishment (if any) should fit that.

ToucanLoucan 3y ago
The blasé attitude of the people building this technology is what makes it horrifying. Literally the FIRST major objections I heard to generative AI/deepfakes was the strong possibility if not guarantee of how it would be utilized by bad actors, be they interpersonal or political in nature. And over and over the tech sphere has downplayed and ignored this reality in favor of the ephemeral "progress" which also happens, by sheer coincidence I'm sure, to be their paths to success both professionally and financially. And on this progress marched until we've reached a place where it is now feasible that a high schooler could take the likeness of a girl he likes, shove it into an image generator, and make porn out of her without her consent or knowledge and be totally free to distribute that however he sees fit. THAT is horrifying. It's horrifying both by the base actions at play and, far moreso IMO, that because someone in the tech space thought it was monetizable enough to warrant investment, it will happen. It did happen. That genie is now out if it's box and when confronted with the ethical dilemmas it seems most people in the engineering space are content to shrug their shoulders and go "shit happens." That's horrifying. It's horrifying that all a technology has to do is demonstrate it's ability to make money, no matter how socially or culturally corrosive it might be, no matter how much harm it might do to individuals or even entire professions, no matter how unethical and just straight up creepy it is, doesn't matter. If it will make someone rich, it will be done, and it will be done with the best hardware and expertise money can buy, and that social order will be corroded, that culture will be corroded, those individuals will be harmed, that profession will be obliterated, and those checks will be cashed. THAT'S horrifying.
munificent 3y ago
> You talk of punishment in the context of physical harm (fist vs. face), while deepfakes concern mental distress at worst. 2nd order effects like reputation damage, lost income etc can be adressed by lawyers. The #2 cause of death for people in the US aged 10-14 is suicide. Suicide is #3 for ages 15-24. > b) If deepfake postings happen often enough, it kinda takes the sting out. Ask any child subject to chronic bullying whether the repeated abuse "takes the sting out".
- lrvick 3y ago
  "Your mom" jokes used to be something someone would start a fight over. Now they only elect an eye roll. At some point soon every teen will know how to generate pictures of anything they can imagine. Teach impacted teen girls how to make deepfakes too and that it is not real. The world is not ready for this, but it is happening and can not be stopped so education is all we have left. It is only shocking right now because it is new and seems like magic. We should be educating teens on body positivity, and that anyone that shares a deepfake of them is announcing of how big of a child they are, and why they should not be taken seriously. It will just become an eye roll once everyone can do it and understands how easy it is. Background noise.

ToucanLoucan 3y ago

The blasé attitude of the people building this technology is what makes it horrifying. Literally the FIRST major objections I heard to generative AI/deepfakes was the strong possibility if not guarantee of how it would be utilized by bad actors, be they interpersonal or political in nature. And over and over the tech sphere has downplayed and ignored this reality in favor of the ephemeral "progress" which also happens, by sheer coincidence I'm sure, to be their paths to success both professionally and financially. And on this progress marched until we've reached a place where it is now feasible that a high schooler could take the likeness of a girl he likes, shove it into an image generator, and make porn out of her without her consent or knowledge and be totally free to distribute that however he sees fit. THAT is horrifying. It's horrifying both by the base actions at play and, far moreso IMO, that because someone in the tech space thought it was monetizable enough to warrant investment, it will happen. It did happen. That genie is now out if it's box and when confronted with the ethical dilemmas it seems most people in the engineering space are content to shrug their shoulders and go "shit happens." That's horrifying. It's horrifying that all a technology has to do is demonstrate it's ability to make money, no matter how socially or culturally corrosive it might be, no matter how much harm it might do to individuals or even entire professions, no matter how unethical and just straight up creepy it is, doesn't matter. If it will make someone rich, it will be done, and it will be done with the best hardware and expertise money can buy, and that social order will be corroded, that culture will be corroded, those individuals will be harmed, that profession will be obliterated, and those checks will be cashed. THAT'S horrifying.

munificent 3y ago

> You talk of punishment in the context of physical harm (fist vs. face), while deepfakes concern mental distress at worst. 2nd order effects like reputation damage, lost income etc can be adressed by lawyers. The #2 cause of death for people in the US aged 10-14 is suicide. Suicide is #3 for ages 15-24. > b) If deepfake postings happen often enough, it kinda takes the sting out. Ask any child subject to chronic bullying whether the repeated abuse "takes the sting out".

lrvick 3y ago
"Your mom" jokes used to be something someone would start a fight over. Now they only elect an eye roll. At some point soon every teen will know how to generate pictures of anything they can imagine. Teach impacted teen girls how to make deepfakes too and that it is not real. The world is not ready for this, but it is happening and can not be stopped so education is all we have left. It is only shocking right now because it is new and seems like magic. We should be educating teens on body positivity, and that anyone that shares a deepfake of them is announcing of how big of a child they are, and why they should not be taken seriously. It will just become an eye roll once everyone can do it and understands how easy it is. Background noise.