4 ms·
The thing is, with current 'privacy-protecting scanner' designs, the scanner is running on every end users device, and it would be fairly simple for an expert t
by londons_explore 5y ago
The thing is, with current 'privacy-protecting scanner' designs, the scanner is running on every end users device, and it would be fairly simple for an expert to dump out the list of things being looked for.
That in turn makes such a system far less useful to intelligence services and authoritarian regimes. You don't want to tell your target that you're looking for them and which keywords not to use!
I wonder if this is part one, and then a later revision will require centralised scanning rather than on-device scanning.
- pc86 5y agoMore like this is part 50,000 of an ∞-part plan to give the government more and more power and oversight.
- gambiting 5y ago>>and it would be fairly simple for an expert to dump out the list of things being looked for. If you embed a neural net trained to detect "some" kind of images, I would love to know how one could "dump" the list of things the net is looking for. Basically it's not how it works - the neural net is more or less a black box, you can't tell what kind of things it's looking for by just looking at its contents. You give it an image, it says it is a match or not, based on some internal algorithm - but looking at that algorithm tells you nothing about what kind of images would produce positive matches.
- stephen_g 5y agoThe hashes are something like a 64x64 pixel representation that can apparently be recovered to a small, very blurry but still recognisable image (when the Apple thing blew up there was a researcher who’d done it with a reimplementation of PhotoDNA from the paper).
- gambiting 5y agoSure, but if you read the article the proposed law by EU specifically mentions detecting brand new and not yet classified CSAM by using machine learning. So it's not just hashes we're talking about here.
- Sakos 5y agoThe EU is constantly pushing to backdoor encryption and allow them unfettered access to communication in flight. Local CSAM is just a stepping stone.
- prirun 5y agoI find it ironic that people often look at the EU as "privacy-focused", with things like the GDPR, while at the same time the EU wants encryption backdoors and photo scanning. IMO, the politicians just want more authority and power. The GDPR gives them power to sue and fine large companies, ie, free money. I don't think it's about privacy any more than encryption backdoors are about fighting crime or photo scanning is about protecting children.
- josefx 5y ago> and it would be fairly simple for an expert to dump out the list of things being looked for. I think the Apple design used some fancy tricks to run the comparisons without ever decrypting the reference data and even if that wasn't possible almost every new device comes with some kind of "trusted" platform module that only "trusted" actors can access.