2 ms·
> - It has been proven that the automated flagging system can be fooled This statement is absolutely false. No such proof has been presented anywhere, includi
by zepto 5y ago
> - It has been proven that the automated flagging system can be fooled
This statement is absolutely false. No such proof has been presented anywhere, including in the linked article.
Adversarial Neuralhash collisions are expected and the system is designed avoid false positives if they are encountered.
Here is the relevant paragraph from Apple’s documentation:
“as an additional safeguard, the visual derivatives themselves are matched to the known CSAM database by a second, independent perceptual hash. This independent hash is chosen to reject the unlikely possibility that the match threshold was exceeded due to non-CSAM images that were adversarially perturbed to cause false NeuralHash matches against the on-device encrypted CSAM database. If the CSAM finding is confirmed by this independent hash, the visual derivatives are provided to Apple human reviewers for final confirmation.”
https://www.apple.com/child-safety/pdf/Security_Threat_Model_Review_of_Apple_Child_Safety_Features.pdf https://www.apple.com/child-safety/pdf/Security_Threat_Model...