2 ms·
> ...be decryptable and contain grayscale low-res versions of the original image for confirmation... But what happens when the false positives are erroneously
by giantrobot 5y ago
> ...be decryptable and contain grayscale low-res versions of the original image for confirmation...
But what happens when the false positives are erroneously confirmed as legitimate CSAM? What's the system in place for removing all the security vouchers on someone's account because the vision system flagged a bunch of false positives? What's the process for unfucking a person's life because the employee confirming the CSAM was in a bad mood that day? Is Apple going to pay the legal bills of someone they effectively SWATed?
For the ones of people this system might actually catch with legitimate CSAM there will be at least as many false positives slipping through to ruinous consequences. Law enforcement shouldn't be trusted as a backstop against abuse because LEOs and DAs are incentivized for "good numbers" and "results", not for actually meting out justice. If someone flagged by false positives gets to the stage of law enforcement being involved their lives will be ruined.
- ChrisKnott 5y ago> "For the ones of people this system might actually catch with legitimate CSAM there will be at least as many false positives slipping through to ruinous consequences." How are you calculating this?
- gjsman-1000 5y agoApple claims without math that it's a 1-in-a-trillion chance that your account will be incorrectly flagged. And even then... what happens? Does the FBI actually smash down your door with a SWAT team for CSAM? In most cases, No. They go and arrest you the normal way. Unless you had a ludicrous amount of false flags (in the thousands) showing you were a dealer and had a previous history.