3 ms·

Generative models are still trained with real data. That output isn't really synthetic, it contains patterns from existing images of victims. Making that legal

by plonk 3y ago

Generative models are still trained with real data. That output isn't really synthetic, it contains patterns from existing images of victims. Making that legal to share doesn't sound right.

onetimeuse92304 3y ago
I don't think generative model requires an image of a victim to create an image of a victim. It could take an image of a nude non-victim child and transform it.
- testtest888 3y ago
  No it can't, not without adding adult features that ruin it for pedophiles. You can't even use NSFW terms on the public Midjourney API - you need to get your own fine tuned model weights.
  - onetimeuse92304 3y ago
    But you can imagine proliferation of models where you can use NSFW terms or where you can cause the model to produce what you want without using NSFW terms. There is no technical reason the models could not in principle produce child porn from non-victim material. And if it is possible I bet somebody will do it. What I was responding was the argument about why AI-child porn should be illegal, and I think the argument is false. And please, don't construe it as me saying whether it should be legal or illegal. AFAIK, in most of the world, the depiciton of child sexual acts is illegal, regardless of the form. So a drawing or animation is also considered illegal, regardless of how it was produced.
  - jeroenhd 3y ago
    > No it can't, not without adding adult features that ruin it for pedophiles The software was downloaded to his laptop, so I doubt the Midjourney restrictions are relevant here. It was probably your run-of-the-mill Stable Diffusion UI with one of the many pretrained models available online, trained on normal (legal) porn.
  - deleted 3y ago
    [deleted]
rutierut 3y ago
This is not how these models work at all. They’re not just advanced copy-paste machines, just like you wouldn’t need to see a house made out of watermelon to imagine it.
- plonk 3y ago
  I said patterns, not literal parts of images.

by plonk 3y ago

Generative models are still trained with real data. That output isn't really synthetic, it contains patterns from existing images of victims. Making that legal to share doesn't sound right.

onetimeuse92304 3y ago

I don't think generative model requires an image of a victim to create an image of a victim. It could take an image of a nude non-victim child and transform it.

testtest888 3y ago
No it can't, not without adding adult features that ruin it for pedophiles. You can't even use NSFW terms on the public Midjourney API - you need to get your own fine tuned model weights.
- onetimeuse92304 3y ago
  But you can imagine proliferation of models where you can use NSFW terms or where you can cause the model to produce what you want without using NSFW terms. There is no technical reason the models could not in principle produce child porn from non-victim material. And if it is possible I bet somebody will do it. What I was responding was the argument about why AI-child porn should be illegal, and I think the argument is false. And please, don't construe it as me saying whether it should be legal or illegal. AFAIK, in most of the world, the depiciton of child sexual acts is illegal, regardless of the form. So a drawing or animation is also considered illegal, regardless of how it was produced.
- jeroenhd 3y ago
  > No it can't, not without adding adult features that ruin it for pedophiles The software was downloaded to his laptop, so I doubt the Midjourney restrictions are relevant here. It was probably your run-of-the-mill Stable Diffusion UI with one of the many pretrained models available online, trained on normal (legal) porn.
- deleted 3y ago
  [deleted]

rutierut 3y ago

This is not how these models work at all. They’re not just advanced copy-paste machines, just like you wouldn’t need to see a house made out of watermelon to imagine it.

plonk 3y ago
I said patterns, not literal parts of images.