3 ms·

(Edit: it seems like the algorithm does not work like I thought it did, you can basically disregard this comment. This has been mentioned on here before, but i

(Edit: it seems like the algorithm does not work like I thought it did, you can basically disregard this comment. This has been mentioned on here before, but it's known CSAM possession that's illegal. Apple keeps your files encrypted until its algorithm thinks your encrypted file is too similar to CSAM, and then it decrypts it and sends it to Apple for review. There's a few things here. - The algorithm is a black box, so nobody knows how many false positives it hits. - Apple's willingness to decrypt files without the consent of the owner makes the encryption seem like a bit of a sham. - I imagine many are skeptical of Apple's ability to judge CSAM accurately. If I take a photo of my kids in a bathtub, is that CSAM? What about teenagers in a relationship sharing nudes. The law is a blunt and cruel instrument, and we've gotten away without hurting too many innocent people so far because the process is run by humans, but computers are not known for being gracious.

rootusrootus 5y ago
> The algorithm is a black box So we know for sure they're not just using PhotoDNA? > If I take a photo of my kids in a bathtub, ..... Kinda the same question. If they're using PhotoDNA, then that's not really a risk, right? Isn't this technology well understood at this point?
- frenchyatwork 5y ago
  Looks like you're right. I edited my comment. It looks like there's a couple fairly different changes that are happening: - There's a system to catch CSAM that is either PhotoDNA or something that works similarly. - There's a system to detect novel nudes, and notify parents if their children view them. I think I got these two mixed together.
  - rootusrootus 5y ago
    > I think I got these two mixed together. That's fair. Apple did a shit job of explaining themselves, and it has been compounded by a lot of misinformation (deliberate or not) in response. I'm trying really, really hard to moderate my reaction to this whole mess until I feel like I actually understand what Apple intends to do. I don't make platform jumps lightly.

rootusrootus 5y ago

> The algorithm is a black box So we know for sure they're not just using PhotoDNA? > If I take a photo of my kids in a bathtub, ..... Kinda the same question. If they're using PhotoDNA, then that's not really a risk, right? Isn't this technology well understood at this point?

frenchyatwork 5y ago
Looks like you're right. I edited my comment. It looks like there's a couple fairly different changes that are happening: - There's a system to catch CSAM that is either PhotoDNA or something that works similarly. - There's a system to detect novel nudes, and notify parents if their children view them. I think I got these two mixed together.
- rootusrootus 5y ago
  > I think I got these two mixed together. That's fair. Apple did a shit job of explaining themselves, and it has been compounded by a lot of misinformation (deliberate or not) in response. I'm trying really, really hard to moderate my reaction to this whole mess until I feel like I actually understand what Apple intends to do. I don't make platform jumps lightly.