3 ms·
It's entirely possible for one innocuous picture to look like an illegal picture in that database, and if they do look similar, they'll have similar perceptual
by heavyset_go 5y ago
It's entirely possible for one innocuous picture to look like an illegal picture in that database, and if they do look similar, they'll have similar perceptual hashes. That's the point of perceptual hashing.
- tpush 5y ago'Similar' hashes wouldn't do anything; the system hashes perceptually similar images (cropped, resized etc.) to the same hash.
- heavyset_go 5y agoNot all transformations result in the same hash, hence why fuzzy matching is necessary. Some perceptual hashing techniques try to incorporate common transformations like rotations and scaling, but if you change an image slightly, but enough, hashes will be different but still similar.
- tpush 5y agoApple's system only concerns exact hash matches, and is built so transformed images hash to the same number.
- heavyset_go 5y ago> and is built so transformed images hash to the same number. That is the goal of all perceptual hashing algorithms. > Apple's system only concerns exact hash matches Then it is almost useless. All someone would need to do to evade the system is make minor enough adjustments to illegal images so that the distance between resulting hash and the original is minor. In reality, perceptual hashing systems use fuzzy matching on hashes by using a metric like hamming distance to calculate differences between two or more hashes.
- tpush 5y ago> Then it is almost useless. I'm sure you're in a prime position to judge that. > In reality, perceptual hashing systems use fuzzy matching on hashes by using a metric like hamming distance to calculate differences between two or more hashes. Again, Apple's NeuralHash purposefully doesn't work like that [0]. [0] https://twitter.com/jonathanmayer/status/1423370142411476993 https://twitter.com/jonathanmayer/status/1423370142411476993
- simondotau 5y agoOr here’s an idea: don’t import CSAM into your camera roll in the first place? This is what I don’t get. I’ve never felt compelled to import regular porn into my camera roll–and that stuff is legal. Who the hell is going to be doing that with stuff they know will land them in prison? I can believe that some people might be stupid enough to believe that a private Facebook group was secure. But who the hell co-mingles their deepest darkest dirtiest secrets with pictures of their family and last night’s dinner?
- skinkestek 5y agoFurthermore - and the extent of this was eye opening to me and I'm not the most naive person: What for parents is "children playing in the pool in the garden - shared on YouTube so grandparents could see it" - is something that is collected into playlists and shared with "interesting" timestamps in certain circles. A story here on HN a couple of years ago about a (for us normal people) totally innocent video having reached a million views or something on YouTube because of this sick and ugly thing. But now we must ask ourselves: is that video CP? No, for everyone else. Yes for these sick bastards. How do you classify that? If it is classified, what happens to the parents when they switch from Android to iPhone and backup the photos and videos to "summer memories 2017" in iCloud?
- simondotau 5y agoI agree that "children playing in the pool in the garden" can function as CP when viewed by a sick bastard. But just because material can function as CP doesn't turn it into CSAM. It would never be classified under any of the formal CSAM categories (A1, A2, B1, B2) unless the video included lascivious exhibition, e.g. focus on genitals, sexual touching or posing, or an aroused adult. The definitions are horrifyingly, depressingly, tragically very clear. I did not enjoy reading them.
- skinkestek 5y agoOK, thanks for the update. I think we more or less agree.