3 ms·

> There are human reviewers at Google, Facebook, and every other organization that has to moderate content. Not a novel idea. For unencrypted content uploaded

by breput 5y ago

> There are human reviewers at Google, Facebook, and every other organization that has to moderate content. Not a novel idea. For unencrypted content uploaded to their servers. That makes it a "Them Problem". Apple's approach is to scan before it is uploaded (and like the article says, "for now" - this can change with only a configuration change for all we know). And this could be a per-jurisdiction option and again, no one would know. You have a point that this is not completely novel problem but do we have actual data on the number of real vs. false positives on the "everyone but Apple" group? Matthew Green probably would know but he doesn't[0]. [0] https://twitter.com/matthew_d_green/status/1428382952858083332 https://twitter.com/matthew_d_green/status/14283829528580833...

breput 5y ago
There is an website[0] set up already to show to show how easy it is to find collisions with a photo of a beagle. The left side photos are all apparently kitten photos but what if it was a photo of the Nirvana baby and, as a human reviewer, you had no access to the right side photo because it was just a hash in an anonymous database? [0] https://thishashcollisionisnotporn.com/ https://thishashcollisionisnotporn.com/
- judge2020 5y ago
  The Nirvana baby, as with many non-sexual pictures of naked babies, isn't considered CSAM and thus wouldn't be flagged. Even if it was, NCMEC reviewers (and Apple reviewers) almost certainly view the original CSAM next to the new photo when they receive potential re-circulations of the photo, if their task is indeed to verify the authenticity of a match. If reviewers had to make a CSAM judgement call on every incoming image, it'd be an extremely brittle system.
robertoandred 5y ago
No one would know? iOS is constantly analyzed by people around the world for security vulnerabilities, strange behavior, etc. Why would this be different?

by breput 5y ago

breput 5y ago

There is an website[0] set up already to show to show how easy it is to find collisions with a photo of a beagle. The left side photos are all apparently kitten photos but what if it was a photo of the Nirvana baby and, as a human reviewer, you had no access to the right side photo because it was just a hash in an anonymous database? [0] https://thishashcollisionisnotporn.com/ https://thishashcollisionisnotporn.com/

judge2020 5y ago
The Nirvana baby, as with many non-sexual pictures of naked babies, isn't considered CSAM and thus wouldn't be flagged. Even if it was, NCMEC reviewers (and Apple reviewers) almost certainly view the original CSAM next to the new photo when they receive potential re-circulations of the photo, if their task is indeed to verify the authenticity of a match. If reviewers had to make a CSAM judgement call on every incoming image, it'd be an extremely brittle system.

robertoandred 5y ago

No one would know? iOS is constantly analyzed by people around the world for security vulnerabilities, strange behavior, etc. Why would this be different?