4 ms·
Apple has outlined[1] multiple levels of protection in place for this: 1. You have to reach a threshold of matches before your account is flagged. 2. Once the
by ncw96 5y ago
Apple has outlined[1] multiple levels of protection in place for this:
1. You have to reach a threshold of matches before your account is flagged.
2. Once the threshold is reached, the matched images are checked against a different perceptual hash algorithm on Apple servers. This means an adversarial image would have to trigger a collision on two distinct hashing algorithms.
3. If both hash algorithms show a match, then “visual derivative” (low-res versions) of the images are inspected by Apple to confirm they are CSAM.
Only after these three criteria are met is your account disabled and referred to NCMEC. NCMEC will then do their own review of the flagged images and refer to law enforcement if necessary.
[1]: https://www.apple.com/child-safety/pdf/Security_Threat_Model_Review_of_Apple_Child_Safety_Features.pdf https://www.apple.com/child-safety/pdf/Security_Threat_Model...
- Dylan16807 5y agoI do want to note that decrypting the low-res images would have to happen before step 2.
- copperx 5y agoWill the high-resolution images be collected and used as evidence? Or just the visual derivatives? That's not clear.
- ncw96 5y agoCurrently, most likely. I don’t believe Apple has said whether or not they send them in their initial referral to NCMEC, but law enforcement could easily get a warrant for them. iCloud Photos are encrypted at rest, but Apple has the keys. (Many have speculated that this CSAM local scanning feature is a precursor to Apple introducing full end-to-end encryption for all of iCloud. We’ll see.)
- only_as_i_fall 5y agoDoesn't disabling the account kind also defeat the whole purpose? I mean assuming the purpose is to catch child abusers and not merely to use this particular boogeyman to introduce a back door for later use.