3 ms·

I don't understand why this is a concern. Someone would need 30 or so child porn images to generate these. Then they'd need to create these grey blobs and send

I don't understand why this is a concern. Someone would need 30 or so child porn images to generate these. Then they'd need to create these grey blobs and send them to the target. The target would need to save them in their photo library for some reason so they sync to iCloud. Then when all this triggers the review they'll see they are grey blobs and nothing else will happen?

teitoklien 5y ago
Its astonishing , How society went from keeping personal photos private , to thinking its ok , to let a random apple employee scan their photos for suspicion and debate on how human reviewers from a faceless corporation can easily stop these mistakes there. I’d trust the algorithm more than the human reviewing it , considering the algorithm already shows flaws and loopholes , the human part of it does not bring any confidence. This isnt facebook , this is your private photos , it shouldnt have reached till this stage , in the first place
- bengale 5y ago
  But they won't be my private photos, the only way it gets to the point where a human see's them is that I have a bunch of child porn uploaded into iCloud, or someone puts a bunch of these grey blob images into my library. Neither of those are my images. There is no chance 30+ of my personal images have hash collisions with this database of child porn. > How society went from keeping personal photos private Also, didn't the local photo development shops used to call the police quite frequently when dodgy images were sent in to be developed? I remember it happening once at our local supermarket.
  - teitoklien 5y ago
    Hash collisions dont need grey images You can take a perfectly normal image , play around with a range of its individual pixels, to get collisions too. So someone might forward you your personal pics from your meeting with them and its pixels might get edited by the messenger app you use to save the picture into your photos to specifically collide its hash with a csam image, while to you the image will look perfectly normal This is one example , lets say you 100% trust every developer of every app that you download on apple’s phone. Fine, but that’s already a lot of trust on a lot of people about something that can ruin your life. Do you now trust every single image which might get auto downloaded to your gallery by a malicious actor , what if a random anon person messages you with 100 such colliding images , enough to cross threshold to get the authorities knocking your door , Is this “feature” really worth it , to have the inconvenience of authorities knocking your door and going through legal trouble ? For an iphone ?
    - bengale 5y ago
      > So someone might forward you your personal pics from your meeting with them and its pixels might get edited by the messenger app you use to save the picture into your photos to specifically collide its hash with a csam image, while to you the image will look perfectly normal Ok, but then that image is already not private, if I've been sending it to someone that could do that. > This is one example , lets say you 100% trust every developer of every app that you download on apple’s phone. I don't have to, they have to ask me before storing images in my photo library. I'm not going to give some fart generator app access to my library. > Do you now trust every single image which might get auto downloaded to your gallery by a malicious actor , what if a random anon person messages you with 100 such colliding images , enough to cross threshold to get the authorities knocking your door Beyond the fact that nothing writes images to my library automatically. If they sent me 100 images that are grey blobs or slightly manipulated normal images they dont get past the check anyway so no police. If they send me 100 CSAM images I'll be on the phone to the police anyway.
      - teitoklien 5y ago
        Great on you , But i dont see my parents disabling the auto feature , nor do my friends. Youre right indeed , you can protect yourself from this , but all the measures you mentioned are settings which are non-default, A lot of apps annoyingly turn it on by default , while HN users can turn it off , I doubt my grandparents will go through the same effort or understand it. Question is , why should they ? Their phone was supposed to help them , not be a snitch and a snitch with flaws at that. Why should my non-tech friends train to protect themselves from “their” phones. Human society has always tried to place co-existence and trust on their fore frontier , their ideal wish for society. This makes us and our devices act as snitches to each other. Snitch for whom ? Apple ? But yes youre right , that if its normal image it will stop at review level , (altho thats on the condition you trust apple employees who are reviewing them) I just still dont think its a good idea to even reach till this step. This just makes our computers feel more hostile
        bengale 5y ago

teitoklien 5y ago

Its astonishing , How society went from keeping personal photos private , to thinking its ok , to let a random apple employee scan their photos for suspicion and debate on how human reviewers from a faceless corporation can easily stop these mistakes there. I’d trust the algorithm more than the human reviewing it , considering the algorithm already shows flaws and loopholes , the human part of it does not bring any confidence. This isnt facebook , this is your private photos , it shouldnt have reached till this stage , in the first place

bengale 5y ago
But they won't be my private photos, the only way it gets to the point where a human see's them is that I have a bunch of child porn uploaded into iCloud, or someone puts a bunch of these grey blob images into my library. Neither of those are my images. There is no chance 30+ of my personal images have hash collisions with this database of child porn. > How society went from keeping personal photos private Also, didn't the local photo development shops used to call the police quite frequently when dodgy images were sent in to be developed? I remember it happening once at our local supermarket.
- teitoklien 5y ago
  Hash collisions dont need grey images You can take a perfectly normal image , play around with a range of its individual pixels, to get collisions too. So someone might forward you your personal pics from your meeting with them and its pixels might get edited by the messenger app you use to save the picture into your photos to specifically collide its hash with a csam image, while to you the image will look perfectly normal This is one example , lets say you 100% trust every developer of every app that you download on apple’s phone. Fine, but that’s already a lot of trust on a lot of people about something that can ruin your life. Do you now trust every single image which might get auto downloaded to your gallery by a malicious actor , what if a random anon person messages you with 100 such colliding images , enough to cross threshold to get the authorities knocking your door , Is this “feature” really worth it , to have the inconvenience of authorities knocking your door and going through legal trouble ? For an iphone ?
  - bengale 5y ago
    > So someone might forward you your personal pics from your meeting with them and its pixels might get edited by the messenger app you use to save the picture into your photos to specifically collide its hash with a csam image, while to you the image will look perfectly normal Ok, but then that image is already not private, if I've been sending it to someone that could do that. > This is one example , lets say you 100% trust every developer of every app that you download on apple’s phone. I don't have to, they have to ask me before storing images in my photo library. I'm not going to give some fart generator app access to my library. > Do you now trust every single image which might get auto downloaded to your gallery by a malicious actor , what if a random anon person messages you with 100 such colliding images , enough to cross threshold to get the authorities knocking your door Beyond the fact that nothing writes images to my library automatically. If they sent me 100 images that are grey blobs or slightly manipulated normal images they dont get past the check anyway so no police. If they send me 100 CSAM images I'll be on the phone to the police anyway.
    - teitoklien 5y ago
      Great on you , But i dont see my parents disabling the auto feature , nor do my friends. Youre right indeed , you can protect yourself from this , but all the measures you mentioned are settings which are non-default, A lot of apps annoyingly turn it on by default , while HN users can turn it off , I doubt my grandparents will go through the same effort or understand it. Question is , why should they ? Their phone was supposed to help them , not be a snitch and a snitch with flaws at that. Why should my non-tech friends train to protect themselves from “their” phones. Human society has always tried to place co-existence and trust on their fore frontier , their ideal wish for society. This makes us and our devices act as snitches to each other. Snitch for whom ? Apple ? But yes youre right , that if its normal image it will stop at review level , (altho thats on the condition you trust apple employees who are reviewing them) I just still dont think its a good idea to even reach till this step. This just makes our computers feel more hostile
      - bengale 5y ago