5 ms·
> allows the producers and distributors of CSAM material to ensure that nearly all of the next generation of CSAM will suffer from hash collisions with perfectl
by yeldarb 5y ago
> allows the producers and distributors of CSAM material to ensure that nearly all of the next generation of CSAM will suffer from hash collisions with perfectly innocent images
That’s a really interesting attack vector I hadn’t seen mentioned previously.
Most people are talking about the potential for adversarial images to be sent to users. If they were instead injected into the database itself (either by poisoning real CSAM or social engineering) that would have far wider ramifications.
I wonder what the most widely-saved pornographic images are across iCloud users.
If actual CSAM were perturbed to match the hash of, say, images from the celebrity nude leak a few years back and added to the database then thousands of users could be sent to “human review”. Since the images are actually explicit how would the human reviewers know not to flag them to authorities?
- theshrike79 5y agoBecause they're not CSAM? People don't seem to grasp what kind of images end up in the CSAM databases. They are most definitely not "leaked celebrity nude selfie" level stuff. Think of the most vile sexual thing you could do to a child and then times that by two and halve the child's age in your mind. That's the shit that gets in there. It's not something even 4chan weebaboos share. It's stuff that makes Liveleak regulars go "ewwwww, gross".
- saithound 5y agoThe issue is not that a celebrity photo might get into a CSAM database. It's that a true CSAM photo, which has been modified to have the same hash as a "leaked celebrity nude selfie", will probably get into a CSAM database.
- theshrike79 5y agoThe CSAM database is not generated by an AI. Actual people hand-pick the worst images to include in the list.
- yeldarb 5y agoHow is the human reviewer expected to make that judgement call? They’re not allowed to see the original to compare with for obvious reasons.
- theshrike79 5y agoThey see a "visual derivative" of the original. I think they can tell the difference between a naked celebrity and a molested child.