9 ms·
An On-Device Deep Neural Network for Face Detection
- margorczynski 9y agoPushing human-identification capable software and libraries everywhere is starting to get pretty creepy...
- yathern 9y agoNot sure if this was your implication - but this is not capable of identifying people in terms of putting a name to a face. Just identifying where there is a face.
- MBCook 9y agoRight. And its used for things like helping the camera make sure it keeps people in focus.
- StanislavPetrov 9y agoWhat it is used for is unrelated to what its capable of doing. The danger always lies in the capability, not the intent.
- lloeki 9y agoPhotos.app is capable of finding faces and then categorizing them though. You put a name on it, and it can even be tied to a contact. Dunno if it’s related to this paper.
- gcr 9y agoThis is not face recognition.
- philjohn 9y agoWhich is why it's nice that Apple do this on-device, rather than the google approach of hoovering up your data and letting them loose on it.
- pat2man 9y agoThis appears to be what powers the basic face detection in the Vision framework, not what powers Face ID: https://developer.apple.com/documentation/vision https://developer.apple.com/documentation/vision It is not capable of identifying individual people, just recognizing faces and facial features in an image. Still quite useful for things like Snapchat's masks.
- trumpeta 9y agoIn my limited trials it was not terribly performant, running at 15fps or so only.
- ctlaltdefeat 9y agoI would consider that pretty performant for a task such as this on a phone.
- cycrutchfield 9y agoCompared to non-DNN techniques? I don’t have concrete numbers but I’m pretty sure “classical” techniques can do this with much higher throughput.
- tedunangst 9y agoWith equal accuracy?
- tzs 9y agoIf the non-NN techniques are faster, but the NN techniques are more accurate, couldn't they be combined to provide both speed and accuracy? Use the NN to find the faces, and the non-NN to track faces once the NN has found them, and use the NN to periodically check to see that the non-NN is still locked on.
- tedunangst 9y ago
- cromwellian 9y agoI feel like this paper reads part like a paper on AI and like a marketing piece humble brag, “back in 2014 when we were doing X” which seems like its trying to say “we’ve been doing DNN image face before Google and Facebook made it popular”. But if you read papers from Google, FB, MS, et al on AI, they don’t have these kinds of humble brags and they contain far more citations of previous work in the field.
- googleAI 9y agoThe entire rebranding of Google to being about "AI" is marketing. All in service of driving sales to Google Cloud.
- bllguo 9y agoThat seems like a particularly cynical reading :) I can't say I got the same impression.
- lloeki 9y agoCould that one refer the the Photos.app (was it in iPhoto already?) feature that matches faces?
- threeseed 9y agoBack in 2014 teams at Apple weren't allowed to release papers. If they were you wouldn't be making this comment since you would be including Apple in the list of companies who do this. Not that this is even a paper. And who cares about Google, Facebook anyway ? They never invented this technology nor were they even the first to incorporate it in shipping products.
- amelius 9y agoWell, the way Apple publishes their results means that other people always have to refer to the "Apple Journal" when they cite those results. Wheareas Apple does not refer to articles published by Google and Facebook in that way (by naming them). There's no single reference to Google or Facebook on that blog (or journal, as they like to call it).
- ucaetano 9y ago
- newscracker 9y agoI understand this article is about face detection, but on a tangential note, face identification against known faces in the Photos app has been laughable for me on iOS 10 (haven’t checked if this has improved in iOS 11, since I don’t have many new photos with new faces). Even with some manual training, the face identification and name matching seemed quite primitive, getting most of its guesses wrong (for example, matching kids’ faces against adults’ faces). That said, I do strongly admire and appreciate Apple’s stance on privacy and the software doing these kinds of work on the device and not on the cloud. I can wait for these things to improve.
- nkristoffersen 9y agoFor me the faces function in ios photos has been pretty amazing. Accurately detecting blurry background faces is surprising. I just checked it and it picked out a picture of me where just my nose and part of a cheek is showing! (aviator sunglasses and scarf covering my face).
- amelius 9y agoIsn't this part of every consumer camera and phone already?
- QasimK 9y agoI really have to applaud Apple for doing these things on the device instead of on their cloud servers. They respect your privacy far more than most large tech companies (I would just say “they respect your privacy, others don’t”.)
- gman83 9y agoWhat are the privacy implications of doing this vs. something like Google Photos? I mean iCloud also has my pictures.
- 8ytecoder 9y agoBut that could technically be encrypted and still provide the same set of features.
- interpol_p 9y agoThey discuss photo and video storage on iCloud specifically: > Apple’s iCloud Photo Library is a cloud-based solution for photo and video storage. However, due to Apple’s strong commitment to user privacy, we couldn’t use iCloud servers for computer vision computations. Every photo and video sent to iCloud Photo Library is encrypted on the device before it is sent to cloud storage, and can only be decrypted by devices that are registered with the iCloud account.
- rahimnathwani 9y agoSo if I throw out all my Apple devices and forget my current iCloud password, the photos are gone? Or does Apple store the encryption key for me somewhere as a convenience, so that once I get new decides and reset my iCloud password, I regain access?
- asimpletune 9y agoThey’re gone
- dontreact 9y agoNo quantization? There’s a lot of optimization being given. Left on the table by doing float math at inference time.
- satyajeet23 9y ago"Every photo and video sent to iCloud Photo Library is encrypted on the device before it is sent to cloud storage"