5 ms·
Then let's get rid of the NeuralHash entirely, if it doesn't matter, right? If it's a critical part of the system, then it should be inspected thoroughly. If A
by tsimionescu 5y ago
Then let's get rid of the NeuralHash entirely, if it doesn't matter, right?
If it's a critical part of the system, then it should be inspected thoroughly. If Apple claims a minuscule chance of a hash collision, and the reality is that collisions are relatively common, that significantly changes the requirements for the backend system, which Apple keeps secret. We have every right to believe, bbased oon ppublic info, that Apple was expecting that NeuralHash would be almost fool-proof, leaving the backend system to be a rubber stamp. This would be tragic.
- toxik 5y agoThe point in the NeuralHash and PSI system is to preserve user privacy as far as possible. From a technical standpoint, it is not essential - a NeuralHash function that returns 0x0000… for everything would still catch CSAM. It's just that it would upload every single image on the user's device. Now, how well this NeuralHash does preserve privacy is a different question, and /not/ one that is being answered by the original post here. In fact, I've not seen anybody look at the hash distribution over natural images, which would be an actual argument against the system.
- Retr0id 5y agoIt doesn't really matter whether all images are uploaded, or just 1 in x (for large value of x), due to the Panopticon effect.
- ithkuil 5y agoLet's not forget what the alternative is: this is about images that are uploaded on icloud anyway. The alternative is to upload the image in clear (or with ane encryption key that apple controls), and let apple run the CSAM filter on their servers. Apple now has the ability to encrypt the images before sending them to icloud, with a private key you own. Except that some percentage of images that match the CSAM fingerprint with their neural feature extractor will be sent to a CSAM filter on the server side (whose workings we don't have many details about) This whole thing backfired on Apple entirely due to psychological effects, not because they are really doing anything more "panopticon" that they would already able to do now on their icloud storage (after all people are ready sending their photos to apple)
- simion314 5y agoBut if Apple really cares about children why they did not done this scans in iCloud like all the others? Did not care as much as Google or Facebook? Seems to me like Apple does not care at all and seems more like a dev with big ego wanted to add neural hashes to his CV but if you can explain how Apple cared for children all this years but only now are doing something I really want to see the explanation
- deleted 5y ago[deleted]
- theshrike79 5y agoBecause Apple is the one company that actively tries not to know anything about you. FB and Google will exhaustively analyse every single facet of your online presence and use your pictures to train their ML models for face detection and object detection. Apple, on the other hand, even explicitly splits Map directions to segments so that they can't know where you left from and where you are going to.
- simion314 5y agoApple was sending unencrypted on the network what application you started, if they would "actively tries not to know anything about you" they could have implemented this better. Anyway how is your assumption make sense , Apple cares about children and about your privacy so scanning your images in iCloud was wrong until 2021 when something changed, what changed? does Apple cares more about children starting from now or they care less about privacy? or are they forced to do it?
- ben-schaaf 5y agoThey already have the decryption keys for iCloud. Undoubtedly they've already been running a similar CSAM filter server-side for ages. The only thing doing this stuff client side has done is reduce privacy and erode trust.
- 5y ago
- read_if_gay_ 5y agoThe “actual argument” against the system that this provides is that Apple lied about the likelihood of hash collisions. Therefore, why trust any of their other claims?
- simondotau 5y agoApple's claims are based on the statistical likelihood that there would be 30 collisions with CSAM hashes within one user account. Just because someone has found an image of a nearly featureless diagonal thing which collides with another image of a nearly featureless diagonal thing, that doesn't disprove Apple's claims.
- BeefWellington 5y ago> Apple's claims are based on the statistical likelihood that there would be 30 collisions with CSAM hashes within one user account. Given people can now generate images that collide, it seems like the statistical likelihood has drastically changed since it was originally announced.
- toxik 5y agoI find this an unconvincing argument as well, you're saying that because Apple made a false claim, any claim may be valid. This is obviously not the case, what they did was to, albeit likely knowingly, calculate the hash collision probability /if each bit is a coin flip/, which comes out to pow(2, -k) for k bits. It's tiny. Of course, each bit is /not/ an independent coin flip under the NeuralHash function. So again the actual argument becomes: what is that distribution like?
- read_if_gay_ 5y agoFine, let’s say they didn’t lie, they made misleading claims. Still. Why trust them after that? If a company can make my own smartphone report me to the police, and they want my business, they better prove I can trust them. Apple has plainly done the opposite. The whole ordeal is just utterly 1984.
- 5y ago
- tsimionescu 5y agoSure, but a NeuralHash system with a collision chance of 100% would obviously not be abused to say NeuralHash collision implies CSAM - the secondary validation system will definitely be the last bastion. In contrast, a NH system believed to have a collision chance of 1 in a trillion trillion may well be considered infallible, and any detection be directly reported as CSAM, with the 'backend verification' amounting to nothing more than a rubber stamp. Of course, if you implicitly trust Apple not to do the second, than you're right, the NH collision rate doesn't matter too much.
- david_draco 5y ago> collisions are relatively common Are they?
- rgovostes 5y agoThe conclusion section of the article associated with the GitHub repo linked here is that collisions are not common and Apple’s published collision probability matches their findings. Furthermore the thresholding scheme requires 30+ independent collisions which is astronomically improbable.