3 ms·

And the NN totally-offline¹ optional configurable check is a good thing! Heck, I'd've enabled it on my own phone if I had an iPhone; it'd've made me feel that m

And the NN totally-offline¹ optional configurable check is a good thing! Heck, I'd've enabled it on my own phone if I had an iPhone; it'd've made me feel that much better about carrying an internet-connected camera around with me wherever I went, if I knew it'd warn me if I accidentally photographed myself naked (or somehow decided to do so deliberately, in a moment of foolishness). They built two different systems, one that I think is good / that would be a selling point to parents, and one that could be a powerful weapon. ¹: The “notifying parents” thing is a little iffy; I'm not sure what to think about it.

VortexDream 5y ago
Honestly, this is deeply concerning. Apple shouldn't be in a position to be able to police what photos we take. If I'm a teen and I sext with a partner, does that mean that in the near future, our messages/photos will be flagged and reviewed for "child porn" and forwarded to police enforcement? That's horrifying and incredibly unfair to young people exploring their sexuality in a completely consensual and normal way. There's nothing wrong with taking pictures of yourself nude and/or sharing these with whoever you want. This goes towards territory that I find deeply uncomfortable.
- UncleMeat 5y ago
  > If I'm a teen and I sext with a partner, does that mean that in the near future, our messages/photos will be flagged and reviewed for "child porn" and forwarded to police enforcement? No. The system looks for files that are similar to known illegal content. It is not a general purpose underage nude photograph detector.
  - wutbrodo 5y ago
    > does that mean that in the near future I think the parent comment is in reference not to the current system, but to potential future functionality, enabled by opening the Pandora's Box of client-side scanning. Though I agree that underage nudity detection in particular is a little fanciful
  - halostatue 5y ago
    That's the other feature. Feature 1: CSAM detection. Only on upload of images to iCloud Photos. Feature 2: nudity detection for minor children controlled via the parents' iCloud account. It is not an “underage” nude photograph detector, but a nude photograph detector. All done on-device. The only person(s) notified are THE PARENTS. This is all opt-in and age-restricted. I do not know whether it will affect teens sexting or only under-13s.
    - wizzwizz4 5y ago
      > The only person(s) notified are THE PARENTS. Notifying the parents is optional (controlled by parents), and only for accounts below a certain age afaik. It primarily notifies the phone's user.

VortexDream 5y ago

Honestly, this is deeply concerning. Apple shouldn't be in a position to be able to police what photos we take. If I'm a teen and I sext with a partner, does that mean that in the near future, our messages/photos will be flagged and reviewed for "child porn" and forwarded to police enforcement? That's horrifying and incredibly unfair to young people exploring their sexuality in a completely consensual and normal way. There's nothing wrong with taking pictures of yourself nude and/or sharing these with whoever you want. This goes towards territory that I find deeply uncomfortable.

UncleMeat 5y ago
> If I'm a teen and I sext with a partner, does that mean that in the near future, our messages/photos will be flagged and reviewed for "child porn" and forwarded to police enforcement? No. The system looks for files that are similar to known illegal content. It is not a general purpose underage nude photograph detector.
- wutbrodo 5y ago
  > does that mean that in the near future I think the parent comment is in reference not to the current system, but to potential future functionality, enabled by opening the Pandora's Box of client-side scanning. Though I agree that underage nudity detection in particular is a little fanciful
- halostatue 5y ago
  That's the other feature. Feature 1: CSAM detection. Only on upload of images to iCloud Photos. Feature 2: nudity detection for minor children controlled via the parents' iCloud account. It is not an “underage” nude photograph detector, but a nude photograph detector. All done on-device. The only person(s) notified are THE PARENTS. This is all opt-in and age-restricted. I do not know whether it will affect teens sexting or only under-13s.
  - wizzwizz4 5y ago
    > The only person(s) notified are THE PARENTS. Notifying the parents is optional (controlled by parents), and only for accounts below a certain age afaik. It primarily notifies the phone's user.