13 ms·
South Korea has jailed a man for using AI to create sexual images of children
- deleted 3y ago[deleted]
- Jigsy 3y agoHad to truncate the title slightly because it was too long.
- laurentlassalle 3y ago> The images were not distributed How did they find him?
- Jigsy 3y agoFrom what I've heard elsewhere, he was being investigated for something entirely different.
- scarmig 3y ago> For years, deepfakes – highly convincing fake videos made using AI – have been used to put women’s faces into often aggressive pornographic videos, without their consent. The videos often appear so real it can be hard for female victims to deny it isn’t really them. Isn't the better approach to make deepfake technology so ubiquitous that everyone can plausibly deny that it's really them?
- CatWChainsaw 3y agoIt's probably the only solution but that doesn't make it a good one.
- SenAnder 3y agoPlus it kills the demand for real child porn. But people would rather get rid of the ick than stop child rape. Take away the emotional fog, and humans understand this, such as the effort to create fake rhino horns to make poaching uneconomical: https://eu.usatoday.com/story/news/factcheck/2021/06/10/fact-check-company-3-d-printed-rhino-horns-help-slow-down-poaching/7523775002/ https://eu.usatoday.com/story/news/factcheck/2021/06/10/fact... *I don't buy the tortured logic in that article that "such production would create opportunities for laundering real wildlife products as cultured products" - if the fake horn is cheaper to make, that's like laundering blood diamonds as coal, at coal's price point. "Another concern is that the fake horns could drive up the demand for real horns. The status that came with owning a real horn would increase as fake horns become commonly available to everyone" likewise doesn't make sense. How could one tell something is indeed a real horn, and not a fake? And why do fakes make real horns more desirable than they were before? Does Rolex encourage counterfeits, to raise their own prices? It also talks only of "ownership", when horns are used for medicine, not just status. I get the impression they worked backwards from their conclusion to find this logic.
- Tade0 3y agoIf the experience from what normally happens to new drugs is anything to go by, the dealers eventually start producing their own fake horns, sell them as real, to the point where there's hardly anyone left who knows how a real one looks like. Eventually poaching for real horns becomes too expensive and not really worth the trouble.
- jeroenhd 3y agoThe fake horn project isn't very successful so far, so perhaps that's not the greatest comparison. The easy availability of generated porn does increase the chances of normalising abhorrent behaviour. AI is also restricted to pictures and writing at the moment, you can't generate videos. If the demand of CSAM does actually go down, I'm all for AI generated CSAM. However, we have little indication that it does, other than "it makes sense that it would".
- Jigsy 3y ago> However, we have little indication that it does [...] Probably because it's one of those things that nobody wants to find out. Especially in countries that have "for-profit" prison systems. The UK is probably a great example of this. They - the government - fired their drugs advisor because he returned an answer they didn't want to hear.
- Kretinsky 3y agoOr you'll get more people hooked on the worst porn, and those with less impulse control will enact their desires. Desire for Rhino horns is nothing like pedophilia, which leads to arguably one of the worst consequences on society.
- rented_mule 3y ago> make deepfake technology so ubiquitous that everyone can plausibly deny that it's really them This seems inevitable given the march of technology. Doesn't this also give plausible deniability to real child porn? This makes child porn laws unenforceable in many cases. Unless fake child porn is also illegal. What trade-off do we want there as a society?
- scarmig 3y agoCSAM markets will get flooded by fakes: no one will know what's real and what's not, and the fake abuse will be easier and cheaper to make. So real CSAM will have plausible deniability, but there's no reason outside of exhibitionist motivations to even produce it. Genuinely not sure how that shakes out in terms of net CSAM production (I suspect the exhibitionistic motivations are significant, though even then, if no one is watching your CSAM because they're all watching the fake CSAM, does it still scratch the exhibitionist itch?), but it seems like the inevitable end point, regardless of what laws are passed.
- throwaway290 3y ago> and the fake abuse will be easier and cheaper to make Sadly, doubtful. It requires a lot of knowledge and expensive hardware, compared to literally only buying some $20 camera to film. The people who will win the most from such normalization is people who like CSAM, and people who will lose the most are the victims.
- advisedwang 3y agoEven if nobody believes the images are real, it's going to be traumatic for a 13 year old girl to discover her peers are passing around fake nudes of her. This shit needs to be illegal. We have libel laws, even though everyone knows the written word can be lies.
- jstarfish 3y ago> it's going to be traumatic for a 13 year old girl to discover her peers are passing around fake nudes of her. This shit needs to be illegal. This scenario is very much illegal in the US. The bar to clear is photorealistic; if you Photoshop a kid's face onto a nude body, you have in fact produced child pornography. Possessing or distributing that image are also crimes.
- thsksbd 3y ago[flagged]
- throwaway4836 3y agoI'm open to being convinced to change my mind here because I'm obviously in the minority. I don't understand why this is illegal. Yes, I agree it's incredibly creepy and weird and uncomfortable but there is no victim here. I'm cool with non-ai CSAM being illegal because it implies the existence of a real victim who was severely harmed and then continuously exploited. If it's all AI-generated though, then who's getting hurt? I don't think it should be illegal just because it's weird
- skullone 3y ago[flagged]
- LewisVerstappen 3y ago> What other stuff are they up to? What actions would these people take to the next level? This isn't a hill to die on. These people are sick, antisocial depraved and likely predators. That’s literally not how any legal system works but ok. You don’t jail someone because you’re concerned of “what else they might be up to”.
- skullone 3y agoWhy are you deflecting away from people are are taking steps to further their fetish of minors?
- version_five 3y agoIs there a precedent for locking people up for being victimlessly deviant? Maybe drug use?
- skullone 3y agoWhy are you deflecting away from people are are taking steps to further their fetish of minors?
- darau1 3y ago
- edu 3y agoThere's a similar case ongoing in Spain [1], where some teenagers (13-15) created explicit images of some of their classmates and distributed them among friends. IMO it's pretty terrible stuff. 1. https://www.theguardian.com/world/2023/sep/25/spanish-prosecutor-investigates-if-shared-ai-images-of-naked-girls-constitute-a https://www.theguardian.com/world/2023/sep/25/spanish-prosec...
- sitkack 3y agoI could see a plausible argument where that would constituted as rape. A sexual crime against the body, but ultimately sexual violence against the mind.
- jeroenhd 3y agoYou're getting downvoted, but I do see this argument more often in non-tech circles. I don't buy it myself, but people do feel very hurt about photoshops and other alterations based on their likeness. I think there's an argument to be made that these pictures provide plausible deniability to blackmail victims, but if the end result is the same (bullying/exclusion/name calling/reputation damage) regardless of whether the images are real or generated, that doesn't really matter. "I will send hundreds of pictures of [someone who looks exactly like you|an AI model of you] unless you do x" is a pretty convincing threat regardless of the origin of those pictures. So far, the general public lacks understanding about the technology and what it can and can't do. That understanding is a crucial step in getting any benefits from the technology.
- Jigsy 3y agoI was thinking about this a while back about how people claim it needs to be based on CSAM/CSEM in order for it to generate these kind of images, which I don't buy because that would make every single model illegal to possess by default. However if we take something like bestiality for example, the AI is going to know what a naked woman looks like and what a dog looks like all without having to be trained on bestiality. But if you're to generate those two words in a sexual context it suddenly becomes illegal (at least in certain countries) because of... flimsy reasons.
- nottheengineer 3y agoShortly after DALL-E 2 launched, social media was flooded with images from DALL-E mini that just showed weird combinations of things that shouldn't be combined. This is exactly what AI is good at, so it definitely doesn't need to be trained on child porn to produce it.
- onetimeuse92304 3y agoEntire topic is so much more complex. I had to explain to my wife, many times, that it is absolutely not a good idea to send me nude pics of my own kids playing while bathing. I had to explain that context (the photo in man's photo library vs the photo on mother's phone) is in fact important and can cause a lot of problem for me. We are asking to clearly delineate on problems that real people can't already do.
- brewtide 3y agoBut it shouldn't be a problem for you. (Not saying it wouldn't be / is not, but should not be). As a single Dad of two elementary aged children, I'm now used to getting the weird glances from other parents on the playground, when I'm either sitting on a swing/bench keeping tabs of them ripping around a playground or in fact playing with them on the playground itself. I shouldn't immediately be eyeballed with the obvious skepticism of others, but I am. On a similar note, in a VERY small town, one isn't able to just go into the school office to talk to the secretary, you likely have to be "buzzed in", and or have the chat via intercom system. It isn't welcoming, and feels more like a prison, honestly. Again, this is in a very small town,bin a very unpopulated state. We are so afraid of the dark that we're causing a whole new world of problems for everyone, and at the same time barely making a dent in the horrible articles that plaster "the news". Sorry, a bit of a ranting, but man the path we are headed on is so damn bleak.
- ushtaritk421 3y agoI don’t think I have a strong opinion on whether computer generated CSAM increases or decreases actual child abuse (could see it going either way or even different ways depending on the time scale). That aside, sometimes we have laws that exist not just for their direct good or bad effects but because they exclude someone we think should be excluded. And if you’re picking people to exclude, people who constitutionally want to rape your kids doesn’t seem like the worst choice.
- HayBale 3y agoIt's crazy disturbing and uncomfortable topic and it kinda remind me of the the interview with a company that creates realistic dolls that can be "hurt", they bleed etc... that changed my opinion about this topic. Do I wish that this stuff did not exists? Yeah, but if somebody find this as a safe ventil for his disturbing urges without inflicting any harm or trauma on others? I would say that this is worthy. And I am not buying the argument about the this could enable people to move to the "real" stuff we have the same arguments in case of violent video games, movies and music. But Jesus live and people are sometimes disturbing.
- iammjm 3y agoWhy is this illegal? The case I am making: 1. There are people who are broken and attracted to kids 2. These people have urges that they want to fulfill 3. It is clearly better if they fulfill said urges without any kids involved 4. So give them AI-generated kiddie stuff to fulfill their urges 5. Having seen AI-produced bee-pug hybrids I don't think the training data needs actual kiddie stuff 6. Seems like a simple, free of suffering solution for a nasty problem 6. I don't see any valid alternatives except for sterilization, which is not ideal either What am I missing?
- Tade0 3y agoAs a parent I would like to know which approach demonstrably reduces the harm done to children. Is there any reliable data on that?
- brigadier132 3y agoThere really is no ethical way to run the experiment that would give us that data.
- Kretinsky 3y agoJust like stopping any representation of smoking in movies, preventing the spread of CSAM, even AI generated, should reduce the consumption. Would you leave your kids for the night at the house of someone who enjoys making AI CSAM?
- hn_acker 3y ago> Would you leave your kids for the night at the house of someone who enjoys making AI CSAM? Probably not, but social ostracization and targeted bans by law (makes AI CSAM = cannot be a teacher) could stand in for a full legal ban. Less importantly, your smoking in movies analogy is not very applicable because smoking is legal and smoking in movies is legal. Also, there are ads for smoking in public, like at gas stations.
- Kretinsky 3y agoSmoking is an example among other, Cinema has been a great way to advertise things. Would you say that video advertising doesn't work? Exposure to CSAM content can be a trigger in some individuals with predisposition. FYI, many countries ban smoking in movies and in advertising (which should be the norm), for this exact reason. For instance, in France: https://en.wikipedia.org/wiki/Loi_%C3%89vin https://en.wikipedia.org/wiki/Loi_%C3%89vin Also, one has to explain to me why the right to own CSAM is so important in their society. Why should the rights of people having a child rape fetish be protected and enforced? How about the rights of the children (and their parents who would like not to live in fear of such individuals).
- kevinsync 3y agoThe guy who ran one of the most fucking disgusting CSAM websites I've ever heard reported on ended up getting less prison time than AI dude. Seems like at least up until late 2020, South Korea had been legally very lenient on this type of material, which is truly mind-boggling. [1] https://en.wikipedia.org/wiki/Welcome_to_Video_case https://en.wikipedia.org/wiki/Welcome_to_Video_case [2] https://www.wired.com/story/tracers-in-the-dark-welcome-to-video-crypto-anonymity-myth/ https://www.wired.com/story/tracers-in-the-dark-welcome-to-v...
- pengaru 3y agoIs it illegal to draw child porn in South Korea? What I'm curious about is how this will play out in Japan, where there's already a thriving industry of animated cheese pizza.
- xboxnolifes 3y agoIsn't all porn banned in South Korea? Is the child aspect actually relevant to the case here, or is it just socially relevant?