4 ms·
The crazy part is forcing a user to run software that undermines their own interests, on a device they purportedly own that is likely a huge part of their life.
by mindslight 4y ago
The crazy part is forcing a user to run software that undermines their own interests, on a device they purportedly own that is likely a huge part of their life. Software running on a computer should represent that computer owner's interest, period.
Apple can run software that represents Apple's interests on their own servers.
- brookst 4y agoMeh. Running it on device means that it is narrowly scoped and transparent. There is no way to secretly add a new hash or to vary what you're searching for depending on a user's location or identity. Running it on their servers means nobody knows how expansive the scans are, and there is nothing preventing ad-hoc scans for arbitrary content for individual users.
- sitzkrieg 4y agousers havent owned devices in quite a while in this space
- ec109685 4y agoThe software uploaded an encrypted fingerprint as metadata as part of every photo. The actual scanning and apple self-interest all happened server side.
- mindslight 4y agoTruthfully generating that fingerprint is not in the user's interest. User representing software would skip doing that. If the storage service required it, it would generate plausible dummy values.
- theshrike79 4y agoWhat part of comparing checksums of images on your device to KNOWN child pornography checksums is "undermining your interests"? This was not some Google-style hotdog or not algorithm that was using "AI" to guess if a photo had a nude person on it or not.
- saagarjha 4y ago1. What's to guarantee that the checksums are of child pornography? 2. What's going on with the "fuzzy comparison"?
- theshrike79 4y agoThe database is generated by the NCMEC[0]. I trust them to have a rigorous process for adding stuff to it. [0] https://en.wikipedia.org/wiki/National_Center_for_Missing_%26_Exploited_Children https://en.wikipedia.org/wiki/National_Center_for_Missing_%2...
- saagarjha 4y agoA lot of the concern is that others may not trust the NCMEC, or that they don't trust that other images won't be added in whatever ends up on your device.
- mindslight 4y agoFirst, the huge possibility of false positives. They're not "checksums", but rather "perceptual hashes", which are nowhere near as solid as a cryptographic hash. When you multiply a small chance of a false positive across hundreds of millions of deployed devices, you end up with many false positives - false positives that result in people being characterized as "child abusers". Second, the overall aim of the technology also targets legitimate or inadvertent activities, that the law has also unjustly criminalized - say taking family pictures of your kids, 17 year olds sexting, or someone trolling you. Once again unjustly branding people as "child abusers", this time with "evidence" to back up the narrative. But even in the case of a proper match to the NCMEC list for its bona fide purpose, that still is undermining the phone's owner's interests. That's the philosophical contour, even if you personally wish to brush it aside with the desire to catch people looking at evil images. Our society respects similar longstanding privacy boundaries, even if it does end up helping some "bad people". It's really not in the NCMEC's interest to respect any of this, as their foundational dynamic is that there is a horrible thing happening in the world, and they must do everything possible to stop it. That kind of advocacy is certainly needed, but we shouldn't just accept their desires as if they're an unbiased neutral party.
- infotogivenm 4y agoIt took me a while of ruminating but I think I like this answer the best. Fundamentally here some people are upset that something they own would betray them. Which is weird, because it implies anything you used but didn’t buy can and should betray you, and it’s your own fault. You should have been smarter. But it makes a bit of sense, for some odd reason I can’t quite make tangible. When the samsung TV I bought starts showing me ads, when my pricey cable or Hulu package interrupts for commercials, I feel a tinge of this. So now I think I somewhat get the feeling. Thank you.
- mindslight 4y ago> because it implies anything you used but didn’t buy can and should betray you, and it’s your own fault The contrapositive isn't automatically true. You can be upset when a cloud host or ISP violates your expectations, even though you don't own them. You can expect Apple to basically work in your interests even on their own servers, since you're paying them. The ownership thing is more about the structure of society. If computing and communications technology is going to move us forward as a distributed democratic society, then those capabilities must remain distributed throughout the population rather than being controlled by a handful of centralized gatekeepers. And yes, we've strayed quite far from this ideal. Most people have little control over what their mobile phone does. Still, there is a distinction between a device not having your desired functionality because the manufacturer didn't create it (or even disallowed others from creating it), and the manufacturer deliberately creating functionality that harms users.