8 ms·

It'll start with protecting children. We all want to protect children, don't we? Why do you want children abused? Are you a child abuser, what do you have to hi

It'll start with protecting children. We all want to protect children, don't we? Why do you want children abused? Are you a child abuser, what do you have to hide? Next it's elderly people. We don't want our forgetful elders to get lost, do we? What if grandma wanders off but is in someone's picture, surely you want the police to know right that second where she is? Next up, terrorists! Four adult brown men in an unmarked van are certainly suspicious, especially near a government building. Your Instagram selfies will help the police in the USA shoot even more innocent people for no good reason. Animal abuse is next. You don't like puppies being abused, do you? Why do you hate puppies? Do you take part in illegal underground dog fights? Gosh, that video looks like it might have been pirated. Nice house, but based on your estimated income it's really strange that you have such a big television. Is that safe full of cash? How much cash is on your table? Is that a bit of dust, flour, or maybe crack cocaine? Is that person asleep or recently murdered?

deleted 5y ago
[deleted]
gjsman-1000 5y ago
Remember that it only scans against a known database of already found content, and does not try to find new content.
- ohazi 5y ago
  For now.
  - dane-pgp 5y ago
    Just as "for now" it doesn't try to stop copyright infringement. Seemingly every aspect of digital technology, from search engines to DNS providers, has been co-opted into the fight against piracy, so I wouldn't be surprised if the media industries started threatening Apple with "contributory infringement" suits if they don't re-purpose this technology for them.
    - antpol 5y ago
      "it would be a shame if AppleTV+ won't get license extension for that popular <insert label/studio> show, isn't it"
      - p2t2p 5y ago
        There's this Apple TV+, a subscription for Apple's originals. I think in relatively short amount of time it'll turn into "It would be a shame if we banned <insert label/studio> from our Apple TV platform"
- nomel 5y ago
  Is this true? The message triggers try to identify nudity within the accounts of minors. Is the notification only going to the parent? Is it stored for possible later use? Are those photos ever reviewed?
  - noduerme 5y ago
    Excellent point. The messaging triggers for nudity in child accounts would imply that there is a separate, on-device scanning capability that has nothing to do with hash matching. Taken together with the backdoor for data exfiltration, and considering these come in the same announcement, there's no reason not to consider them part of the same spyware framework.
dwaite 5y ago
> It'll start with protecting children. We all want to protect children, don't we? Why do you want children abused? Are you a child abuser, what do you have to hide? To be clear, this is continued enforcement for years-old regulation. The feature is only enabled in the US where it is required. The implementation is changing from cloud-based matching (which requires photos to be readable by their cloud infrastructure) to local based matching with threshold tokens (which would allow them potentially to be in compliance while making the system E2E encrypted w two additional key release mechanisms (key escrow via separate audited HSM systems, the given threshold disclosure of the image encryption key)
- antpol 5y ago
  > while making the system E2E encrypted w two additional key release mechanisms (key escrow via separate audited HSM systems, the given threshold disclosure of the image encryption key) such a long sentence to say "backdoor"
- dannyobrien 5y ago
  Could you point to the regulation that requires this?
  - macintux 5y ago
    See the “Federal CSAM Law” section here: https://cyberlaw.stanford.edu/blog/2020/01/earn-it-act-how-ban-end-end-encryption-without-actually-banning-it https://cyberlaw.stanford.edu/blog/2020/01/earn-it-act-how-b... > Section 2258A of the law imposes duties on online service providers, such as Facebook and Tumblr and Dropbox and Gmail. The law mandates that providers must report CSAM when they discover it on their services, and then preserve what they’ve reported (because it’s evidence of a crime).
    - dannyw 5y ago
      The law doesn't require them to actively go around scanning for it.

deleted 5y ago

[deleted]

gjsman-1000 5y ago

Remember that it only scans against a known database of already found content, and does not try to find new content.

ohazi 5y ago
For now.
- dane-pgp 5y ago
  Just as "for now" it doesn't try to stop copyright infringement. Seemingly every aspect of digital technology, from search engines to DNS providers, has been co-opted into the fight against piracy, so I wouldn't be surprised if the media industries started threatening Apple with "contributory infringement" suits if they don't re-purpose this technology for them.
  - antpol 5y ago
    "it would be a shame if AppleTV+ won't get license extension for that popular <insert label/studio> show, isn't it"
    - p2t2p 5y ago
      There's this Apple TV+, a subscription for Apple's originals. I think in relatively short amount of time it'll turn into "It would be a shame if we banned <insert label/studio> from our Apple TV platform"
nomel 5y ago
Is this true? The message triggers try to identify nudity within the accounts of minors. Is the notification only going to the parent? Is it stored for possible later use? Are those photos ever reviewed?
- noduerme 5y ago
  Excellent point. The messaging triggers for nudity in child accounts would imply that there is a separate, on-device scanning capability that has nothing to do with hash matching. Taken together with the backdoor for data exfiltration, and considering these come in the same announcement, there's no reason not to consider them part of the same spyware framework.

dwaite 5y ago

> It'll start with protecting children. We all want to protect children, don't we? Why do you want children abused? Are you a child abuser, what do you have to hide? To be clear, this is continued enforcement for years-old regulation. The feature is only enabled in the US where it is required. The implementation is changing from cloud-based matching (which requires photos to be readable by their cloud infrastructure) to local based matching with threshold tokens (which would allow them potentially to be in compliance while making the system E2E encrypted w two additional key release mechanisms (key escrow via separate audited HSM systems, the given threshold disclosure of the image encryption key)

antpol 5y ago
> while making the system E2E encrypted w two additional key release mechanisms (key escrow via separate audited HSM systems, the given threshold disclosure of the image encryption key) such a long sentence to say "backdoor"
dannyobrien 5y ago
Could you point to the regulation that requires this?
- macintux 5y ago
  See the “Federal CSAM Law” section here: https://cyberlaw.stanford.edu/blog/2020/01/earn-it-act-how-ban-end-end-encryption-without-actually-banning-it https://cyberlaw.stanford.edu/blog/2020/01/earn-it-act-how-b... > Section 2258A of the law imposes duties on online service providers, such as Facebook and Tumblr and Dropbox and Gmail. The law mandates that providers must report CSAM when they discover it on their services, and then preserve what they’ve reported (because it’s evidence of a crime).
  - dannyw 5y ago
    The law doesn't require them to actively go around scanning for it.