4 ms·

Honestly, this is deeply concerning. Apple shouldn't be in a position to be able to police what photos we take. If I'm a teen and I sext with a partner, does th

Honestly, this is deeply concerning. Apple shouldn't be in a position to be able to police what photos we take. If I'm a teen and I sext with a partner, does that mean that in the near future, our messages/photos will be flagged and reviewed for "child porn" and forwarded to police enforcement? That's horrifying and incredibly unfair to young people exploring their sexuality in a completely consensual and normal way. There's nothing wrong with taking pictures of yourself nude and/or sharing these with whoever you want. This goes towards territory that I find deeply uncomfortable.

UncleMeat 5y ago
> If I'm a teen and I sext with a partner, does that mean that in the near future, our messages/photos will be flagged and reviewed for "child porn" and forwarded to police enforcement? No. The system looks for files that are similar to known illegal content. It is not a general purpose underage nude photograph detector.
- wutbrodo 5y ago
  > does that mean that in the near future I think the parent comment is in reference not to the current system, but to potential future functionality, enabled by opening the Pandora's Box of client-side scanning. Though I agree that underage nudity detection in particular is a little fanciful
- halostatue 5y ago
  That's the other feature. Feature 1: CSAM detection. Only on upload of images to iCloud Photos. Feature 2: nudity detection for minor children controlled via the parents' iCloud account. It is not an “underage” nude photograph detector, but a nude photograph detector. All done on-device. The only person(s) notified are THE PARENTS. This is all opt-in and age-restricted. I do not know whether it will affect teens sexting or only under-13s.
  - wizzwizz4 5y ago
    > The only person(s) notified are THE PARENTS. Notifying the parents is optional (controlled by parents), and only for accounts below a certain age afaik. It primarily notifies the phone's user.

UncleMeat 5y ago

> If I'm a teen and I sext with a partner, does that mean that in the near future, our messages/photos will be flagged and reviewed for "child porn" and forwarded to police enforcement? No. The system looks for files that are similar to known illegal content. It is not a general purpose underage nude photograph detector.

wutbrodo 5y ago
> does that mean that in the near future I think the parent comment is in reference not to the current system, but to potential future functionality, enabled by opening the Pandora's Box of client-side scanning. Though I agree that underage nudity detection in particular is a little fanciful
halostatue 5y ago
That's the other feature. Feature 1: CSAM detection. Only on upload of images to iCloud Photos. Feature 2: nudity detection for minor children controlled via the parents' iCloud account. It is not an “underage” nude photograph detector, but a nude photograph detector. All done on-device. The only person(s) notified are THE PARENTS. This is all opt-in and age-restricted. I do not know whether it will affect teens sexting or only under-13s.
- wizzwizz4 5y ago
  > The only person(s) notified are THE PARENTS. Notifying the parents is optional (controlled by parents), and only for accounts below a certain age afaik. It primarily notifies the phone's user.