14 ms·
Apple is sharing your facial wireframe with apps
- arca_vorago 9y agoNotice the deafening silence.
- JustSomeNobody 9y agoGive it a moment, everyone is in scrum.
- noitsnot 9y agoBack from my scrum. It will take a lot to move myself away from Apple products, but the continuation of issues from last week isn't helping at all. I don't own the iPhone X, but now it's not even a thought. The entire pitch of face id was that it was x times more secure. You can't just give away that data.
- JustSomeNobody 9y agoI'll certainly have to give this more thought, but I do agree that last week's issues, and well, iOS and MacOS in general, are not up to the quality that Apple users (myself included) expect nor that Apple themselves portray.
- arbie 9y agoAs I understand it, apps will have access to emotions and other abstracted info about the user, but not the "face" as a reproducible element. This will be interesting for engagement analysis.
- AlexandrB 9y ago> This will be interesting for engagement analysis. Of course it will, which is why this is another very troubling development in phone software. It's bad enough that most (all?) interactions are logged and data mined in a modern app. Soon emotional data will be too.
- dang 9y agoWould you please not post unsubstantive comments? There's no more information content in this than silence has.
- mortenjorck 9y agoI can appreciate the desire to limit the proliferation of permission dialogs, but this seems like a case where the implications are different enough to warrant a separate one from the camera dialog. This has some similarities to the location permission dialog, which was updated in iOS 11 to differentiate between "allow always" and "allow while using the app." Perhaps the camera permission dialog could be updated to "allow continuous access" and "allow when taking photos."
- TaylorAlexander 9y agoWhat’s interesting is that on the previous security method - fingerprint - no data was shared with apps. If your face is now a security feature and the data is being shared with apps, that sounds like a security leak. If an app collects your face data, can that data be subpoenaed by a court to attempt to unlock your phone? If a court could work with an outside party to use subpoenaed face data to 3D print your face, could they try to use that to unlock your phone? I’m satisfied with the fingerprint scanner on my phone. I don’t feel like I need the change in tech. I understand if you’re really concerned about security use a passcode only, but it’s still true that the new face unlock is “differently secure”.
- baddox 9y agoThe thing is, I don’t think the 3D scanner really introduces that much functionality beyond what could be done with any normal front-facing camera and software. I’d bet that a few seconds of normal movement would provide enough parallax to build a decent 3D model. In fact, the Apple APIs may not even use the 3D scanner, given that Animojis apparently work with the scanner covered up (and don’t work in the dark).
- djrogers 9y ago>the Apple APIs may not even use the 3D scanner, given that Animojis apparently work with the scanner covered up (and don’t work in the dark). Animoji uses all of the front sensors - RGB and TrueDepth. From https://www.imore.com/yes-animoji-uses-truedepth-camera-system-iphone-x https://www.imore.com/yes-animoji-uses-truedepth-camera-syst...: > the TrueDepth camera system captures a crude depth mask with the IR system and then, in part using the Neural Engine Block on the A11 Bionic processor, persistently tracks and matches facial movement and expressions with the RGB camera.
- nicky0 9y agoBut face data is not shared with apps for security/unlock purposes. Access to the live face data stream is provided for features like silly Snapchat filters ("turn your face into a lion" type crap) which the user may opt in to.
- bwang29 9y agoThe problem in here is more or less awareness of sharing or how to prevent accidental sharing of face data. I can see sharing to some photo editing app in anonymized fashion being useful for certain things and better than say, using a flat photo from Instagram or Facebook, but sharing faces on social media is a lot more intentional than a small and hidden agree to share with app button. I think a better solution is when app is specifically requesting face data, there is a 2-3 seconds mandatory decision time with the default option to be off and prompt this decision in a different UI from the classic permission request dialogue. In this way the user knows the request is different And is given time to actually decide before accidentally tapping agree.
- adpirz 9y agoI'm honestly less worried about Apple than others. They've at least made some measures to prove that they are willing to go some distance to protect privacy, even losing ground to competitors in voice recognition. Now thinking about co's like Facebook that not only has access to far more imagery of faces tied to sentiments and moments but have shown time and time again that privacy is a secondary concern AND that they're willing to use any and all that data to actively pursue vulnerable populations [1], I get quite nervous. [1] https://www.theguardian.com/technology/2017/may/01/facebook-advertising-data-insecure-teens https://www.theguardian.com/technology/2017/may/01/facebook-...
- lisper 9y ago> I'm honestly less worried about Apple than others. That's a pretty low bar. Yes, Apple at least gives lip service to security which other companies don't even bother to do, but Apple has had some pretty major security screwups lately (three in the last few weeks). You might be less worried about Apple than the competition, but you'd do well to be somewhat worried about them nonetheless.
- gaius 9y agoIndeed. Intent counts for nothing if the capability to secure the data is lacking. All companies claim to be secure, to respect your privacy yadda yadda...
- thisacctforreal 9y agoTwo other issues I'm worried about with iOS: - MAC address tracking (RTS packets thrwart MAC randomization[0], not immediately clear if WiFi is fully off[1]) - All-or-nothing access to photos on the phone (append-only for apps that request it) Discord in particular is bad for the photo permission, as I don't trust China's Tencent with access to all the photos on my phone (which can include lots of frequent location information!), but pasting images doesn't work in the app. I had assumed the "Photos" permission meant "permission to prompt this dialogue" and "permission to save to Camera Roll". [0] https://arxiv.org/pdf/1703.02874v1.pdf https://arxiv.org/pdf/1703.02874v1.pdf [1] https://support.apple.com/en-us/HT208086 https://support.apple.com/en-us/HT208086
- reacharavindh 9y agoSo instead of asking Apple API to authenticate a user via FaceID, apps are going to obtain this data themselves and record it forever? I remember Steve talking on stage about how Apple would always make the operating system retain control of sensitive sensors and only give the result to user-approved apps(asking for permission every time). That's all thrown out of the window now?
- djrogers 9y agoThis is not FaceID data, nor is it a replacement for it - the data available to apps is less granular than that used by FaceID, and is designed to give app developers the ability to create things like Animoji or any other creative uses of the 3D sensor data. >I remember Steve talking on stage about how Apple would always make the operating system retain control of sensitive sensors and only give the result to user-approved apps(asking for permission every time). That's all thrown out of the window now? Why would you think that? Apps do request permission for this, and it can be revoked.
- yeldarb 9y agoI've been playing with the TrueDepth Camera APIs on the iPhone X. Some things I've noticed: 1) The ARKit "Face Mesh" seems to be a standard model that is scaled and skewed to fit your face (for example, it ignores glasses, still works if you put your hand in front of your face, etc). It is _not_ a 3D scan. 2) The "TrueDepth" data is not really all that granular. It seems similar to the depth map you get from the rear-facing cameras on the "plus" sized models. Here's what the sensor data spits out: https://twitter.com/braddwyer/status/930682879977361408 https://twitter.com/braddwyer/status/930682879977361408 3) Apple is really good at marketing. It's been shown that, even if you cover the TrueDepth camera, features that "require" it still work fine (including Animoji and the apps that I've been developing using the front-facing ARKit APIs). 3.1) The lack of Animoji and front-facing ARKit seems to be a software limitation made for business reasons rather than a hardware limitation. See: Google's Pixel 2 portrait mode photos done using a single front-facing camera that have stacked up well against the ones from the iPhone X. 4) The scary part, which is vast dystopian databases of facial fingerprints is already being done with normal photographs. The depth data is not needed. I agree with the author that the privacy implications of all-encompassing databases could be scary. But I disagree that this has anything to do with the iPhone X or its TrueDepth camera.
- GuiA 9y ago#3 is mistaken. https://www.imore.com/yes-animoji-uses-truedepth-camera-system-iphone-x https://www.imore.com/yes-animoji-uses-truedepth-camera-syst...
- JustSomeNobody 9y agoI take anything Rene says with a very large grain of salt. > The reason for the misconception comes from the implementation: The IR system only (currently) fires periodically to create and update the depth mask. The RGB camera has to capture persistently to track movements and match expressions. In other words, cover the IR system and the depth mask will simply stop updating and likely, over time, degrade. Cover the RGB, and the tracking and matching stops dead. "...likely, over time, degrade." 1) He doesn't know. 2) It's Animoji, so why would it matter if it did degrade? There is already a stock 3D image of the Poop. It simply needs the RGB camera to track where your facial features are.
- mtgx 9y agoTell me again how FaceID will be "so much more secure" than TouchID - when Apple itself is sharing those 3D facial profiles with third-party vendors (and governments). In practice, fingerprint readers should still remain significantly more secure than any facial recognition technology.
- djrogers 9y agoApps get a coarse depth map - this cannot be used to replicate your face in perfect 3D, nor can it be used to bypass FaceID.
- wuliwong 9y agoI'm not a security expert but this seems like are giving out a coarse approximation of my username (that has no password protection). I would think it is significantly easier to break into FaceID starting with the coarse depth map than no depth map at all. But again, I could just be out of my depth on this topic and the difference isn't that big of a deal?
- yeldarb 9y agoIt's possible but I 3D printed the face mesh from their API and it didn't work to unlock Face ID on my phone. It did a pretty good job of scanning my face though: https://twitter.com/braddwyer/status/930594896523567104 https://twitter.com/braddwyer/status/930594896523567104
- wuliwong 9y agoI admit that I am pretty ignorant to the really technical aspects of security but it seems that using authentication data for anything other than authentication is poor practice. I can understand the desire to use facial stuff to make interesting technology but I would prefer knowing that it is only used for the purpose of unlocking my device and nothing else. It seems fingerprints are less interesting for other apps so there wasn't the same motivation to share it. Am I being an alarmist or is it reasonable to be concerned about this?
- pmontra 9y agoThe FaceID camera is infrared and can see in the dark [1]. According to the Post "Once you give it permission, an active app keeps on having access to your face until you delete it or dig into advanced settings. There’s no option that says, “Just for the next five minutes.”" So a random developer can (kind of) look at us when we turn the light off. Not only that, those cameras work also in the sunlight. You can go on YouTube and search "clothes transparent to infrared". Not much, especially considering that the app is not getting a real image, but still somebody will be uncomfortable with that. However there also legit and interesting applications for infrared cameras and they've been on sale for a long time. What's changing is the number of those cameras that are getting around. [1] https://www.macrumors.com/2017/09/13/how-iphone-x-face-id-works/ https://www.macrumors.com/2017/09/13/how-iphone-x-face-id-wo...
- _puk 9y ago"Once you give it permission, an active app keeps on having access to your face” Isn’t the definition of an active app, one that is open and in the foreground? The minute the phone sleeps, or the app is put into the background, access becomes more at Apple’s discretion. I’d expect an app running in the foreground to be able to keep using the camera as long as needed.. Or is your point more: allowing once allows it every time the app opens, with no option to repeatedly prompt?
- pmontra 9y agoI have no direct experience of iOs but according to the post it's as you wrote. It could be an app that needs the camera once for some sensible reason, then it can use it forever when it's active even if it wouldn't need it from the point of view of the user.
- jpttsn 9y agoUsers might notice the battery penalty.
- eridius 9y agoApp developers aren't given raw access to the IR camera though.
- tinus_hn 9y agoSo you mean to tell me that an app that gets camera permission can get at the things seen by the camera? Oh no!
- nerdponx 9y agoThe scariest part about this tech is not what my phone will do with my face, but what other people's phones will do with my face. Facebook, Snapchat, and Instagram were bad enough. Am I going to have to start wearing a mask in public just so I don't have my face tracked, sold to the highest bidder, and left in unsecured databases for hackers to obtain?
- natch 9y agoLet’s not jump to conclusions here based on assumptions and ignorance. What is likely being shared is a generic wireframe with pose and expression information. Not a face fingerprint as some are breathlessly calling it.
- zeep 9y agoa precise wireframe could be as precise as a fingerprint... If it has a very high mesh count, it is just a high resolution 3D model of your face... much more information then what is required to face-id you look at this model for example, it has medium amount of mesh: http://image.shutterstock.com/display_pic_with_logo/279553/108981035/stock-photo-high-resolution-concept-or-conceptual-d-wireframe-human-male-head-isolated-on-black-background-as-108981035.jpg http://image.shutterstock.com/display_pic_with_logo/279553/1...
- adjkant 9y agoNot sure why this is being downed. I haven't looked into the details of this case, but the more detailed the wireframe mesh the faces are being fit to, the more possibilities there are, and the lower the likelihood of collisions between two people. Think of it as a hashmap with the number of buckets being determined by the mesh quality. At a certain point, a few collisions won't hinder apps from capitalizing on the information.
- StanislavPetrov 9y agoApple is very popular among the HN crowd. Any comment critical of Apple or skeptical of their intentions will be immediately rejected by a substantial number of readers.
- Bud 9y agoClickbait headline. Apple isn't doing what the headline implies. The headline's hype also does not remotely match the contents of the article. Which leads me to discredit the article in general and look for a more reliable source on what is actually happening.
- deleted 9y ago[deleted]
- walterbell 9y agoThis article has an image comparing iPhone X mesh resolution to other 3D depth-sensing cameras, https://www.linkedin.com/pulse/warby-parker-should-you-worry-newest-app-interview-tomas-petrikaitis/ https://www.linkedin.com/pulse/warby-parker-should-you-worry...
- LeicaLatte 9y agoWhat is this 'facial wireframe' this Jeff Bezos owned newspaper is speaking about? Looks invented just to write this article.
- yeldarb 9y agoIt's unclear whether he's talking specifically about the ARSCNFaceGeometry[1] or the ARFrame.capturedDepthData[2] or some combination of both. [1] https://developer.apple.com/documentation/arkit/arscnfacegeometry https://developer.apple.com/documentation/arkit/arscnfacegeo... [2] https://developer.apple.com/documentation/arkit/arframe/2928208-captureddepthdata https://developer.apple.com/documentation/arkit/arframe/2928...
- Sir_Cmpwn 9y agoThis is 100% likely to be sent to advertising companies who will 100% attempt to use it to track you near their billboards et al.
- acqq 9y agoAnd to develop their own new "fingerprints" and "big data" bases about who "owns the eyeballs".
- dmart 9y agoYou know how some F2P games will allow you to watch video ads in order to e.g. earn extra in-game currency, activate a point multiplier, etc? As it stands, you can start one of these ads and then turn your phone upside down, or look away. How long until an advertising provider makes use of the attention API and makes it so that you can't look away? Seems bleak.
- bcyn 9y ago"15 Million Credits" from Black Mirror vibes there.
- bluetidepro 9y agoThis came to mind to me, too. haha
- muninn_ 9y agoThe good thing is that the first time an app does that you can just delete it. You also don't have to use FaceID for your phone. You can just create an alpha numeric code if you'd like and use that as your password.
- yeldarb 9y agoAs far as I know there's no "Attention" API. It also seems intentional that Apple has omitted an eye-tracking API as well (even though it seems like that would be trivial for them to add from a technical perspective) Is there anything stopping them from doing this with the front-facing camera on existing phones?
- eridius 9y agoApple would probably reject apps that ask for camera access just to track user attention, and even if they didn't, asking for camera access in an app that doesn't have a reasonable reason to want it is a huge red flag and will get the app uninstalled by a lot of people.
- 9y ago
- pwdisswordfish2 9y ago"We take privacy and security very seriously," Apple spokesman Tom Neumayr said.
- dejawu 9y agoSomething alarming occurred to me: Apple has to be saving all of the faces of people who come into Apple stores and do the Face ID demo. There's no reason for them not to do that, they'd be leaving good data on the table otherwise.
- eridius 9y agoOn the contrary, Apple explicitly would never in a million years want to do that. That's a massive liability with no upside whatsoever. Google and Facebook and other such companies treat personal data as an asset and try to collect as much as they can. Apple treats personal data as a liability and wants to have no more than they need to operate.
- luxuryballs 9y agowhat would be so good about the data?
- fjsolwmv 9y agoIs it controlled by app permissions?
- jchb 9y agoYes, same as the camera record permission (NSCameraUsageDescription).
- gaius 9y agoSo let me get this straight: you can unlock your iPhone with your face and Apple is giving away a free high-quality 3D scan of your face to anyone who wants it, who may or may not also own a 3D printer?
- briandear 9y agoYou don’t have it straight. That isn’t what’s happening.
- WhiteNoiz3 9y agoIsn't this a bit like saying that Apple is sharing your photograph with apps [that use the camera]?
- polock 9y agoWHaaaaat? Does Apple explain details about this? When the moment they share those data to other apps?
- teknologist 9y agoTime to switch to Android.
- k3a 9y agoSituation is quite bad for all smartphones. But for Android there is at least f-droid.org repository made of apps automatically compiled from the source code. I prefer using these apps. And the fact you can install what you want. In iOS you are locked into a censored AppStore and have to pay to get a certificate to run your own app. There is also a small chance for someone to develop an Android phone with fully open software in the future. There is 0% chance to have an open iPhone.
- sklinger 9y agoNot 100% true. On iOS you can install your own apps from Xcode for free, you have to pay the $100/year developer fee to distribute it on the app store.
- peruzin 9y agoI mean, didn't they demo the wireframe masks for Snapchat during the keynote? Didn't that imply that apps can see your facial wireframe?
- xoshey 9y agoi contracted the service of an online private detective/investigator to help me spy on my cheating girlfriend and the results were helpful,for any hack job contact cyberwizard,he is the right man for the job,just tell him I referred you CONTACT:CYBERWIZARDHACK at GMAILdotCOM Whatsapp: +1317 794 1276
- xoshey 9y agoI'm Sheyla when i notice that my husband is cheating on phone, whatsapp, facebook, and other websites, i hired CYBERWIZARD to help me spy on his phone and all site he usually visited. with help of globahacking i am able know know that he is really cheating me. globahacking gave clear evidence of all his cheating activities with different woman and i got all the update directly on my phone.Anyone here who need any sort of hacker help you contact by email: CYBERWIZARDHACK @ GMAILdotCOM OR Whatsapp: +1317 794 1276