3 ms·

What are authorities going to do when there's an image generation AI model that can output infinite amounts of CSAM? Are they going to keep trying to enforce t

What are authorities going to do when there's an image generation AI model that can output infinite amounts of CSAM? Are they going to keep trying to enforce these laws, which have good intent (at least by some advocates) but end up being a disaster that barely puts a dent in the problem, while massively increasing government power and decreasing privacy?

rpmisms 3y ago
I've used this example (CSAM-making AI models) as an illustration of the difference between ethics and morals many times. It would be theoretically ethical to use these models. It would, however, be immoral. Since governments are allergic to morality these days, it's going to get a lot worse before it gets better.
- smabie 3y ago
  Why would it be immoral?
  - Try1275 3y ago
    I think the argument is that the models are trained on real pics? The other argument could be that it increases the chances of someone moving on from the consumption state to the abuse state.
    - jeltz 3y ago
      The second part could also be the other way round. If there is easy access to CSAM maybe there will be less abuse. I could see either case be true, or that the availability of such material does not change incidence of abuse st all. But having to train models on real materials is a major moral issue.
      - Try1275 3y ago
        > The second part could also be the other way round. If there is easy access to CSAM maybe there will be less abuse. I could see either case be true, or that the availability of such material does not change incidence of abuse st all. This is actually my opinion but I have no hard data on this. Is it feasible to apply the same logic as with video games where realistic killing is depicted and the argument is that this doesn't make people killers in real life?
ziddoap 3y ago
Related (from today): https://news.ycombinator.com/item?id=37716928 https://news.ycombinator.com/item?id=37716928 South Korea has jailed a man for using AI to create sexual images of children
- AnthonyMouse 3y ago
  It's not new information that this kind of content is illegal, in many countries even if it's only computer-generated. The issue is that hash-based scanning will be rendered irrelevant by AI-generated images because there could be an unlimited number of them, and they could be produced by general-purpose image generating software that isn't itself illegal.

rpmisms 3y ago

I've used this example (CSAM-making AI models) as an illustration of the difference between ethics and morals many times. It would be theoretically ethical to use these models. It would, however, be immoral. Since governments are allergic to morality these days, it's going to get a lot worse before it gets better.

smabie 3y ago
Why would it be immoral?
- Try1275 3y ago
  I think the argument is that the models are trained on real pics? The other argument could be that it increases the chances of someone moving on from the consumption state to the abuse state.
  - jeltz 3y ago
    The second part could also be the other way round. If there is easy access to CSAM maybe there will be less abuse. I could see either case be true, or that the availability of such material does not change incidence of abuse st all. But having to train models on real materials is a major moral issue.
    - Try1275 3y ago
      > The second part could also be the other way round. If there is easy access to CSAM maybe there will be less abuse. I could see either case be true, or that the availability of such material does not change incidence of abuse st all. This is actually my opinion but I have no hard data on this. Is it feasible to apply the same logic as with video games where realistic killing is depicted and the argument is that this doesn't make people killers in real life?

ziddoap 3y ago

Related (from today): https://news.ycombinator.com/item?id=37716928 https://news.ycombinator.com/item?id=37716928 South Korea has jailed a man for using AI to create sexual images of children

AnthonyMouse 3y ago
It's not new information that this kind of content is illegal, in many countries even if it's only computer-generated. The issue is that hash-based scanning will be rendered irrelevant by AI-generated images because there could be an unlimited number of them, and they could be produced by general-purpose image generating software that isn't itself illegal.