3 ms·

I was under the impression that iMessage does its own scanning as well. I could be wrong; I don't use an iphone.

by na85 5y ago

simondotau 5y ago
The proposal to perform scanning of photos in iMessage was an entirely different thing. It would look for photos that were likely to be sexually explicit and show a warning message prior to displaying them, but only where: 1. The account is for a child under the age of 13 2. The account was configured with family sharing 3. The feature was enabled by a parent Results of these scans would remain entirely local to the device and—with the consent of the child—also sent to the parent. But I think this last feature has been dropped.
- genewitch 5y ago
  Please cite something relating to any of this; in August the uproar was that the phone would scan, too. Not just icloud.
  - marcellus23 5y ago
    Feels a bit silly to have to cite this but Apple’s original proposal is quite readable: https://www.apple.com/child-safety/ https://www.apple.com/child-safety/
  - JimDabell 5y ago
    You’re confusing two entirely different features. One feature does blind CSAM detection on iCloud photos. Any photos that are being added to iCloud in the USA have a safety voucher calculated on-device and attached to the upload. The device doesn’t know if there’s a match or not. When the uploads reach Apple’s servers, if there are enough matches, Apple has enough information to decrypt the safety vouchers. The photos are then additionally compared with a second, secret hashing algorithm. If those also match, a human reviewer checks a low-res thumbnail to confirm. If they also confirm, it gets reported. So the initial calculation of the safety voucher is done on-device, but the matching can only be completed on the server, and nothing gets reported unless multiple other checks also match. The other feature uses machine learning to determine whether or not a photo attached to a message contains nudity. If such an image is received by a child’s iPhone, it’s blurred out and they are told that if they choose to view it, their parents will be told about it. The entirety of this scanning happens on-device.

I was under the impression that iMessage does its own scanning as well. I could be wrong; I don't use an iphone.

by na85 5y ago

I was under the impression that iMessage does its own scanning as well. I could be wrong; I don't use an iphone.

The proposal to perform scanning of photos in iMessage was an entirely different thing. It would look for photos that were likely to be sexually explicit and show a warning message prior to displaying them, but only where: 1. The account is for a child under the age of 13 2. The account was configured with family sharing 3. The feature was enabled by a parent Results of these scans would remain entirely local to the device and—with the consent of the child—also sent to the parent. But I think this last feature has been dropped.

genewitch 5y ago
Please cite something relating to any of this; in August the uproar was that the phone would scan, too. Not just icloud.
- marcellus23 5y ago
  Feels a bit silly to have to cite this but Apple’s original proposal is quite readable: https://www.apple.com/child-safety/ https://www.apple.com/child-safety/
- JimDabell 5y ago
  You’re confusing two entirely different features. One feature does blind CSAM detection on iCloud photos. Any photos that are being added to iCloud in the USA have a safety voucher calculated on-device and attached to the upload. The device doesn’t know if there’s a match or not. When the uploads reach Apple’s servers, if there are enough matches, Apple has enough information to decrypt the safety vouchers. The photos are then additionally compared with a second, secret hashing algorithm. If those also match, a human reviewer checks a low-res thumbnail to confirm. If they also confirm, it gets reported. So the initial calculation of the safety voucher is done on-device, but the matching can only be completed on the server, and nothing gets reported unless multiple other checks also match. The other feature uses machine learning to determine whether or not a photo attached to a message contains nudity. If such an image is received by a child’s iPhone, it’s blurred out and they are told that if they choose to view it, their parents will be told about it. The entirety of this scanning happens on-device.