4 ms·

That was my understanding too, but seems like to handle the vast amount of image recognition required for faces and also objects which they demoed; there would

That was my understanding too, but seems like to handle the vast amount of image recognition required for faces and also objects which they demoed; there would need to be a large data set to learn from, and results from that learning saved. The data set to learn from probably can be gathered from stock photos or other open source images, but can that learning be saved down to phone and used to compare against, or would it be too big? If too big, does that mean characteristics of an image would be computed on the phone sent to the cloud compared and the results sent back?

GrantS 10y ago
Yes, the results of all the learning can be saved in a compact form which is efficiently run on the device. Apple just yesterday unveiled their neural network API [1] which they are presumably using for these tasks. The description states: "BNNS supports implementation and operation of neural networks for inference, using input data previously derived from training. BNNS does not do training, however. Its purpose is to provide very high performance inference on already trained neural networks." So they're really saying that no data leaves the device for either object or face recognition at classification time. Now, whether they are using iCloud-stored photos (which the user has already agreed to share) for training, I don't know, and any privacy issues would still be important at that point. [1] https://developer.apple.com/reference/accelerate/1912851-bnns https://developer.apple.com/reference/accelerate/1912851-bnn...