4 ms·

well, slow down, there's always tradeoffs. deepfake child porn means that any prosecution or attempt to help the victims now has to go through an additional "w

well, slow down, there's always tradeoffs. deepfake child porn means that any prosecution or attempt to help the victims now has to go through an additional "was the victim a real human being?" phase, which adds both confusion and expense. add the fact that any system which can generate just one realistic image can also generate 10 million of them, and you get a deluge of deepfakes which could allow the real stuff — the kind that also functions as criminal evidence — to hide in plain sight.

jstarfish 3y ago
> deepfake child porn means that any prosecution or attempt to help the victims now has to go through an additional "was the victim a real human being?" phase, which adds both confusion and expense. Where on earth is this true? If you're in the US and involved in that scene, you'd better reread the law. The verbiage was ahead of its time and specifically-phrased to mitigate these very shenanigans: "photorealistic," not "photographic." One of the fun things people used to do was create a diptych of a child's face next to a scene involving a faceless/cropped-but-legal teen. Technically, no child was harmed, but simply framing it that way runs afoul of US law. We do not fuck around on this. The UK has convicted people for manga. > add the fact that any system which can generate just one realistic image can also generate 10 million of them, and you get a deluge of deepfakes which could allow the real stuff — the kind that also functions as criminal evidence — to hide in plain sight. Hahaha. Considering the above, I would advise against generating and possessing 10 million photorealistic CSAM images.
- candiodari 3y ago
  Yeah what is currently still in doubt is what happens if you do what some websites currently do, and send out the machine learning model, to be run client-side, rather than any actual graphic material. No doubt the police would want to convict. But that's a problem, because nobody is sure whether their model can't be used to generate things that would be considered CSAM (what does it even mean for an imagined model to be a minor? Now of course the same applies to manga)

jstarfish 3y ago

> deepfake child porn means that any prosecution or attempt to help the victims now has to go through an additional "was the victim a real human being?" phase, which adds both confusion and expense. Where on earth is this true? If you're in the US and involved in that scene, you'd better reread the law. The verbiage was ahead of its time and specifically-phrased to mitigate these very shenanigans: "photorealistic," not "photographic." One of the fun things people used to do was create a diptych of a child's face next to a scene involving a faceless/cropped-but-legal teen. Technically, no child was harmed, but simply framing it that way runs afoul of US law. We do not fuck around on this. The UK has convicted people for manga. > add the fact that any system which can generate just one realistic image can also generate 10 million of them, and you get a deluge of deepfakes which could allow the real stuff — the kind that also functions as criminal evidence — to hide in plain sight. Hahaha. Considering the above, I would advise against generating and possessing 10 million photorealistic CSAM images.

candiodari 3y ago
Yeah what is currently still in doubt is what happens if you do what some websites currently do, and send out the machine learning model, to be run client-side, rather than any actual graphic material. No doubt the police would want to convict. But that's a problem, because nobody is sure whether their model can't be used to generate things that would be considered CSAM (what does it even mean for an imagined model to be a minor? Now of course the same applies to manga)