17 ms·
iPhone apps can tell many things about you through the accelerometer
- waylandsmithers 5y agoThis would support the theory that Facebook can listen to you and serve ads on things you talk about even if you haven't given it microphone access right? I'd assume they have enough data to be able to translate vibration patterns into language.
- jonplackett 5y agoThe flip side of this argument is that having to explicitly allow accelerometer use is a bit of a pain - especially on the web where it's quite nice to just be allowed to make your design react to device motion without having to ask. Maybe they could just reduce the sensitivity slightly to prevent things like speech recognition working (though I am skeptical of that working in the real world)
- nemetroid 5y ago> especially on the web where it's quite nice to just be allowed to make your design react to device motion without having to ask. What kinds of motions and reactions would that be, beyond rotations (which are a much higher-level API than raw accelerometer data)?
- afavour 5y agoThe web has a DeviceMotion API that provides such higher level data: https://developer.mozilla.org/en-US/docs/Web/API/DeviceMotionEvent https://developer.mozilla.org/en-US/docs/Web/API/DeviceMotio... Originally it wasn’t behind a permission prompt so you could do the little design flourishes the OP described. But now you have to request access. Orientation change events (i.e. portrait to landscape) remains accessible without permissions, though.
- nemetroid 5y ago> the little design flourishes the OP described And what flourishes are those?
- afavour 5y agoAn example I’ve seen (I forget where but hey, it won’t work now anyway) is to move some background elements to create a parallax effect, like iOS itself does: https://www.idownloadblog.com/2013/06/28/ios-7-parallax-effect-explained/ https://www.idownloadblog.com/2013/06/28/ios-7-parallax-effe... I’m not trying to make out that it’s a crucial feature or anything but it’s a useful case study in permission gating things: it’s small enough that you’d never trigger a permission prompt to ask to do it, so you just don’t instead, and lose a class of nice subtle design flourish.
- Pulcinella 5y agoJust FYI for anyone wondering: I believe this parallax effect specifically uses the UIMotionEffect API. It’s designed to be a simple and straightforward way to implement these kinds of effects without the developer having to worry about cleaning up the raw, noisey motion data. It has a few limitations/features. I don’t think it necessarily always runs at the screen refresh rate. It will also “self level” after a while. So if the user rotates their device and this causes a UI effect, if they hold their phone still the effect will reset after a few seconds. https://developer.apple.com/documentation/uikit/uimotioneffect/ https://developer.apple.com/documentation/uikit/uimotioneffe...
- jonplackett 5y agoNot talking about raw data. Clearly that isn’t needed for the web. But my point is that it got thrown out with the bath water.
- aaaaaaaaaaab 5y ago>it's quite nice to just be allowed to make your design react to device motion without having to ask IDGAF about your design. I want my privacy.
- jonplackett 5y agoI think there are multitude more invasive ways to invade your privacy than allowing access to the accelerometer. I just think this so massively overblown - especially for a web page that has soooooo many other ways to track you.
- paxys 5y agoThe most blatant (mis)use of this was Uber using vibration data to figure out which drivers were getting notifications from the Lyft app while they had Uber running.
- 43920 5y agoSource?
- wyuenho 5y agoIs this why the M1 Pro/Max MBPs also come with an accelerometer and gyroscope [1] even if it doesn't come with mechanical hard drives? Because Apple needs to support Catalyst apps? [1]: https://www.ifixit.com/Guide/MacBook+Pro+14-Inch+2021+Chip+ID/145718#s296627 https://www.ifixit.com/Guide/MacBook+Pro+14-Inch+2021+Chip+I...
- nemacol 5y agoReminds me a bit of these stories 10 years ago. https://www.wired.com/2011/10/iphone-keylogger-spying/ https://www.wired.com/2011/10/iphone-keylogger-spying/ "The accelerometers in many smartphones could be used to decipher what you type into your PC keyboard. "
- aaaaaaaaaaab 5y ago>Facebook reads the accelerometer all the time. Facebook actually shows a support prompt if a shake event is detected across the app. This could be one reason why Facebook reads accelerometer data. No. Shake gestures are handled at the OS level and you only get began/changed/ended callbacks. Raw accelerometer data requires the CoreMotion framework, and it’s a lower level API. They are definitely using it for something else. This is also confirmed by this: >The prompt has an option to switch this feature off. However, switching it off doesn’t stop the app from reading the accelerometer.
- jbverschoor 5y agoWell it's handy to know if your phone is being held, in the car, on your desk. You can 'track' if someone glanced at notifications, doing a spaced-repetition type delay between glances. Or maybe you want notification when you're looking at your phone (certain angle and shakeyness). Or maybe when you're on the phone (different angle).
- RicoElectrico 5y ago> They are definitely using it for something else. Like 3D and 360 photos.
- moffkalast 5y agoYou'd need the gyro for that, more like.
- jonplackett 5y agoIf they were really only using it for this, it would only activate when viewing them. It's good practice to only activate the accelerometer when in use because it uses up battery.
- jtbayly 5y agoIt uses essentially no battery. IIRC, it uses so little that even when your phone battery runs out and the phone turns off, the accelerometer keeps counting your steps.
- speedgoose 5y agoFacebook/Meta developers have no moral, exhibit 5843352.
- durnygbur 5y agoDo you want the stock price to grow or not? Do you want to maintain lion share of the ad market in the developed world or not?
- matheusmoreira 5y ago> Do you want the stock price to grow or not? At the cost of privacy and peace of mind? No.
- rStar 5y agothey do get profit sharing though
- rStar 5y agobut no walls, no personal space and not a moment to themselves outside of a stall in the toilet. it’s quite the hellhole.
- DeathArrow 5y ago>outside of a stall in the toilet Until they'll make toilets open space.
- 5y ago
- mcherm 5y agoFor comparison, how are the controls on access to accelerometer data on Android?
- meibo 5y agoThe APIs are not restricted, but are now rate-limited to make inference of information like this very hard. https://developer.android.com/guide/topics/sensors/sensors_overview#sensors-rate-limiting https://developer.android.com/guide/topics/sensors/sensors_o...
- boibombeiro 5y agoIIRC the rate was limited because someone showed it could be used as microphone.
- vultour 5y ago200Hz really isn't in the ballpark of making this "very hard".
- kroltan 5y agoNo permissions required to read motion data. If I remember correctly, it might be necessary to declare the capability in a manifest, but there's certainly no prompt, nor a way to opt-out of an app reading motion data in the settings.
- sp1rit 5y agoyou can "opt out" using adb by revoking the gyro permission. some non-google androids also have the possibility of revoking it with the ui, or even going as far as to promt for it (graphene os)
- makeitagoood 5y agoGrapheneOS has a Sensors permission toggle to allow/disallow an app accessing sensors.
- krono 5y agoChrome and Edge allow access to motion sensor data by default as well. Edit: Both the desktop and mobile browsers.
- onion2k 5y agoThe user has to perform an action to initialise the Generic Sensor API, just as they do with sound. That's just a click or a keypress, but you can't get sensor data without it.
- krono 5y agoI can access some basic sensor data on default Edge without any confirmation. All it takes is some sneaky activation hidden in a navlink. Motion Sensor: Allow (default)
- onion2k 5y agoSure, but that's still a user action. The point is that the browser can't read anything simply by the user landing on the page - the user has to do something to enable it, even if they're not aware of the consequence of that action. This stops most malicious usage.
- _trampeltier 5y agoDoes a website also have access to the accelerometer data (via browser)?
- XCSme 5y agohttps://developer.mozilla.org/en-US/docs/Web/API/Accelerometer https://developer.mozilla.org/en-US/docs/Web/API/Acceleromet... https://developer.mozilla.org/en-US/docs/Web/API/Gyroscope https://developer.mozilla.org/en-US/docs/Web/API/Gyroscope To use this sensor, the user must grant permission to the 'gyroscope' device sensor through the Permissions API.
- krausefx 5y agoOn iOS, it used to be the case (https://krausefx.com/blog/ios-privacy-whats-the-user-doing https://krausefx.com/blog/ios-privacy-whats-the-user-doing), however with iOS 13 (https://github.com/w3c/deviceorientation/issues/57#issuecomment-498417027 https://github.com/w3c/deviceorientation/issues/57#issuecomm...) this has been addressed.
- vletal 5y ago> Now, if this social app is reading accelerometer data on your phone as well as the passenger’s phone, the app can easily figure out that both phones experience the same vibration pattern. ... Don’t be surprised if you receive a recommendation from the app to add this passenger as a friend. Overall I find the article interesting but this quote is borderline tinfoily. Given the amount of noise in the accelerometer data and signal s much closer to the sensor than the bus itself - such as body movements, it would be hardly precise. Moreover the cost of doing all that research and computation as well as data transfer would hardly pay off.
- xattt 5y agoIs the accelerometer sensitive enough to detect vibrations from sound and voices?
- TedDoesntTalk 5y agoYes - read the article
- api 5y agoSounds plausible to me. The question is whether anyone is really using this technique. Sounds like it would require nontrivial bandwidth and analysis.
- enriquto 5y ago> The question is whether anyone is really using this technique. No. This is not at all the question. A possible privacy breach is a serious issue, regardless of whether there is a working POC. If this data is somehow compromised, a stalker could get your identity just by following you a few minutes on the street.
- vletal 5y agoSure, but the article makes it seem that this is a thing done in a wild on a mass scale which is implausible.
- durnygbur 5y agoDefault permission for all apps to use accelerometer, recognizing sounds from the accelerometer? This would explain the situation when I talk about something nearby my iphone and then relevant ads appear in the internet browser on the device, or within local network.
- yosito 5y agoThe microphone also explains this. I keep a tight reign on which permissions I give apps. I rarely get accurately targeted ads. Last week I suddenly noticed that the ads I was seeing on Facebook were matching the conversations I'd had that day. I immediately knew an app had been eavesdropping on me. Turns out I had given Instagram microphone and camera permission "while the app is in use" earlier in the day to try out an Instagram feature I was curious about, and forgot to turn it off. Even though I wasn't using the camera or mic intentionally, Instagram was still spying on me. This really should be illegal behavior by apps.
- ryantgtg 5y agoHow long does the app stay in use? I have insta installed (for a business that I’m slacking on) and I open it about once a month for roughly 1 minute. Maybe I should just uninstall and reinstall it each time I need to use it.
- ryantgtg 5y agoFollowing up to myself: I just realized that the Background App Refresh setting for each app is a permission that you don't get prompted for. It was enabled on my phone for loads of apps. Why isn't there a prompt for this?
- charcircuit 5y agoIt was probably a coincidence or the targeted ad simply was accurate.
- matheusmoreira 5y ago> I talk about something nerby my iphone and then relevant ads appear in the internet browser on the device How do I stop this?
- kypro 5y agoI wonder if there is a market for a smart phone with a hardware disconnect switch for all of its sensors? Mic, accelerometers, camera, ambient light, etc? I'd love to be able to flick a switch and just disable everything. I'm paranoid about my devices listening to me without my permission. The only issue is that for such a feature to be useful it probably couldn't disconnect everything, wifi and mobile data would probably need to remain software switches for example.
- fsflover 5y ago> I wonder if there is a market for a smart phone with a hardware disconnect switch for all of its sensors? Mic, accelerometers, camera, ambient light, etc? https://puri.sm/products/librem-5 https://puri.sm/products/librem-5 https://puri.sm/posts/lockdown-mode-on-the-librem-5-beyond-hardware-kill-switches/ https://puri.sm/posts/lockdown-mode-on-the-librem-5-beyond-h...
- sva_ 5y agoThe Pinephone also has hardware switches: https://wiki.pine64.org/wiki/File:Pinephone_backside.png https://wiki.pine64.org/wiki/File:Pinephone_backside.png Wish the hardware was better.
- fsflover 5y agoBut Pinephone's switches are not easily accessible: You can't switch your microphone on while receiving a call (unlike on Librem 5). Also, no lockdown mode for sensors.
- megous 5y agoYou can't really trust HW switches either. Someone who has physical control over the phone for a while can easily short the switch so that it's basically on all the time no matter the position. (they can do it at the same time they'll be installing the SW backdoor) ;)
- spuz 5y agoIt's possible Facebook uses the accelerometer for bot detection or click fraud detection. They could use the data to help work out whether a human is interacting with the phone or a robot (do an image search of "click farm" if you want an idea of why this might work).
- doopy1 5y agoThis is the #1 use in my experience. Anti-bot detection.
- Nextgrid 5y agoIt's still a breach of privacy unless it's properly disclosed to the user, and there's a fair question to be asked as to whether the bot/non-bot detection can classify which "bot" it's looking at, and if so whether the same can be applied to track users.
- marderfarker2 5y agoAs if click farms can’t spoof accelerometer already? Or skip physical hardware altogether.
- nindalf 5y agoThey do both. Mass simulators with faked sensor data as well as phones on racks manipulated by mechanical digits. A phone that never moves at all doesn’t detect former but it does detect the latter.
- mschuster91 5y agoAdvertising and advertising fraud are possibly the worst thing that has happened to privacy in general. Advertisers fight against privacy protection so they can shove ever better targeted ads for shit we don't need down our throats, and fraudsters force advertisers to engage middle men that resort to even worse tactics than advertisers do just to clamp down a tiny bit on fraud. As for the click farms - I would not be surprised if the next step will be gimbal mounts that mimic an actual human's movement...
- xutopia 5y agoI wished it could tell where I am in the underground tunnel when the GPS doesn't have a connection.
- andylynch 5y agoLooking at https://stackoverflow.com/questions/7829097/android-accelerometer-accuracy-inertial-navigation https://stackoverflow.com/questions/7829097/android-accelero... it seems that this could be doable - generally it looks like these devices are too noisy for straightforward inertial navigation, but constraining the problem to how far along your train is in a tunnel with occasional wifi is much more possible.
- Aachen 5y agoOccasional WiFi? In a tunnel? Usually GPS devices assume you just maintain speed, which for most tunnels works out.
- makeitagoood 5y agoThere are Android OSes like GrapheneOS with sensors permission so that apps won't have access to them unless you grant them access.
- poisonoushydra 5y agoThis is just one more reason to use a secure operating system such as GrapheneOS which has implemented a sensors toggle for all apps: https://grapheneos.org/features https://grapheneos.org/features "Sensors permission toggle: disallow access to all other sensors not covered by existing Android permissions (Camera, Microphone, Body Sensors, Activity Recognition) including an accelerometer, gyroscope, compass, barometer, thermometer and any other sensors present on a given device. To avoid breaking compatibility with Android apps, the added permission is enabled by default."
- afavour 5y agoOn the other hand, the nature of Apple’s BDFL ownership means that they could very easily add a permission prompt in an iOS release, allowing them to default to disabled, then tell app developers to update their code or go to hell. They’ve done it before with other APIs. In fact they’ve already done this on the web: the DeviceMotion API is behind a permission prompt. I’m surprised the same isn’t the case for apps.
- derekjdanserl 5y agoIf Apple did that, giant app developers would whine about it. Google was basically responsible for locking down the DeviceMotion API.
- e_proxus 5y agoGiant app developers do complain about it (see the ad tracking debacle). That hasn’t stopped Apple in the past.
- afavour 5y agoIIRC Apple locked down the Contacts API precisely because giant app developers were abusing it. And look at the recent ad tracking stuff that Facebook hates: I don’t think Apple is all that afraid of angering developers, big or small.
- _rdvw 5y ago
- davbryn1 5y agoWell, Facebook do use accelerometer for 360 panorama view. Could be as simple and they initialise coroMotion when the app becomes active in order to have their render react without a new initialisation each time?
- felipesoc 5y agoOne thing I thought regarding the new iOS IDFA rules is that someone could fingerprint people by using accelerometer and touch gestures to create some sort of new IDFA shared across apps.
- ChicagoBoy11 5y agoDoes anyone have any examples of this stuff working out in the real world? Particularly curious about the "we used accelerometer data" part of it to infer that these two individuals were in the same place.
- DerekBickerton 5y agoThe accelerometer/gyroscope would be a great tool for spotting click-farms. Bunch of phones in the same location, in the same position, and rarely move...something shady's happening.
- mynameismon 5y agoCould that also not be a showroom?
- spicybright 5y agoWatch them then rock the phone board on a back massage machine or something.
- pie42000 5y agoShould be trivial to detect
- spicybright 5y agoShould be trivial to get around tbh. You just need something to gently the devices. Or hell, use developer tools to simulate it. It's all an arms race, but the click farms have the advantage.
- kvark 5y agoIt could be a different kind of farm, like an automated testing farm.
- charcircuit 5y agoIf it's your automated testing farm then whitelist them. Else why are you letting other people's testing farm do weird stuff on your service?
- kingcharles 5y agoOne of the articles posted to HN recently covered this by talking about faking the accelerometer data to make it look like the phones were being randomly moved, so I guess the bot guys are already on top of this, from both sides of the war.
- zupreme 5y agoSo…nobody wants automatic portrait/landscape rotation anymore?
- wongarsu 5y agoSo for context I looked at the papers behind the scenarios. - The heart rate sensing is done on a smart watch, not a phone, and needs data from the actual heart rate sensor every couple of days [1]. - The breathing rate is determined from a phone put on the breast or the abdomen [2]. Not really a threat vector in that form. - The audio stuff is incredibly impressive [3], but it doesn't look like they can reconstruct text with meaningful reliability, it's more about identifying the person or at least the gender of the person on the other end of the line. The location and activity detection scenarios seem the most credible to me, but the for targeted attacks the audio reconstruction might also work. The other two don't really seem credible to me yet, but good to be aware of them. 1: https://arxiv.org/pdf/1807.04667.pdf https://arxiv.org/pdf/1807.04667.pdf 2: http://www.ijetch.org/vol8/900-M302.pdf http://www.ijetch.org/vol8/900-M302.pdf 3: https://arxiv.org/pdf/1907.05972.pdf https://arxiv.org/pdf/1907.05972.pdf
- KermitTheFrog 5y agoUsing the accelerometer/gyro data, you can also guess the password from the device with quite good accuracy(it depend) if you type in your hand and not on a flat surface.
- mimsee 5y agoIs there an application on iOS that can listen for the accelerometer/gyro data on the background?
- eyelidlessness 5y agoHealth definitely does (and likely needs to for much of its functionality), but it’s first party so you’ve pretty much already trusted the vendor with that data.
- djrogers 5y agoNo you can't - apps can't read Core Motion data when your screen is locked, or they're in the background.
- a9h74j 5y agoRelevant systematic review: accelerometers and privacy[1] [1] https://dl.acm.org/doi/pdf/10.1145/3309074.3309076 https://dl.acm.org/doi/pdf/10.1145/3309074.3309076
- dotancohen 5y agoA guy that I studied with had his company bought by a tech giant. Not FAANG, but a big company that you've heard of. Their product - in production - was to map establishments such as stores and provide data about what the clients were looking at. Did you walk past the mens' shirts and turn your body? Noted. Did you stop at the condoms? Noted. This was all done with the accelerometer, if the user had a "compatible app" installed. A lot of apps carried their technology from what I understand. I actually thought that this was a well-known use of our devices' accelerometer until I read the responses in this thread.
- charcircuit 5y agoaccelerometers drift WAY too much for that to work maybe it worked in tandem with reading the strength of wifi access points or tried to use GPS (this might not work well indoors)
- dotancohen 5y agoI don't know the whole tech stack, I only got this much information after surreptitiously bumping into him one day. They had a few dozen devs and years invested in the company - and this was in 2017 or 2018. I'm sure that there were other technologies involved, in fact I do think that both GPS and some in-store box which was already used to record passing IMEIs were involved.
- lotsofpulp 5y ago>I only got this much information after surreptitiously bumping into him one day. I am confused how "surreptitiously" could be used in this context. Were you spying on him?
- dotancohen 5y agoI was not planning on meeting him - but we sat next to each other on the train. The previous time that I had seen him was a decade prior when he bought my modified N-Gage.
- acomjean 5y agoInteresting. Apple seems to track the accelerometer data in the background. (Why health app can tell you about steps and stairs...) But beyond that data leakage is an interesting problem. 10 years ago I started working at a company that did home power monitoring. We used my bosses house to test. When he went on vacation you could clearly see it in the power use. The daily rhythms of a home (laundry on wed, out late on certain nights ), when they cooked. It all had become very apparent under the guise of just monitoring how much power you were using. We switched to selling to businesses shortly after which was much better. Though those that wanted to generate as much as they used and monitored it were interesting and provided good feedback on the product. Our Big Boss's said his wife got a little aggravated with him, when he noted she had come in early (you can keep your toys just don't talk to me about it), and he noted his house cleaners operated by turning on all the lights in his house, and turning them off only when finished cleaning a room... Its a weird world, and the data you put out there might say more than you think.
- DeRock 5y agoThis type of stuff has come a long way, eg. see https://sense.com https://sense.com Its not just overall electricity use over time, but by doing high frequency spectral analysis, they can identify the type of load, eg. your washing machine is running, or your oven is on.
- acomjean 5y agoThat was just starting to happen when I left. We would just put a current transformer on the mains and each circuit and label it to try and glean details. It was a difficult install, and this new kind of install is way easier .. We wondered how well it could separate out the individual circuits.
- runjake 5y agoGet a story, such as "Facebook using Core Motion APIs to uniquely identify users!" to go viral, and Apple will patch it real quick. In fact, Facebook may actually be doing this now, after the recent actions taken to nerf advertisers (yay).
- RubberShoes 5y agoI have always suspected this and curious what TikTok is reading. For example, if I put my phone down and the video showing continues to loop, does TikTok's algo ignore my 'time watching' because it is aware my phone is on a surface vs in my hand.
- itake 5y agoCompanies also use accelerometer data to know if the phone is running in a simulator.
- gnu8 5y agoThat suggests a cool little project to build a module that fakes the output of an accelerometer without being obviously fake.
- rconti 5y agoNot super related, but my Physical Therapist was super impressed that my phone could show my left/right imbalance ("walking asymmetry" in iOS health). It's been a pretty good measure of my progress in recovery post-surgery. She had no idea this even existed, and then had a second patient point it out to her just a week or two later. I imagine Android has similar features (or 3rd party apps can be installed to do so).
- bentcorner 5y agoFor Android a fun toolkit to play with the accelerometer is phyphox: https://play.google.com/store/apps/details?id=de.rwth_aachen.phyphox&hl=en&gl=US https://play.google.com/store/apps/details?id=de.rwth_aachen... My favorite trick is turning on the spectrum histogram history graph and placing the phone on a computer with a spinning HDD - you can trivially determine the RPM of the HDD from the spike in the graph just by eye.
- Aachen 5y agoHuh, the spectrum goes to a few hundred hertz (edit: 250 to be precise, on Android 11, Samsung high end device (but second hand, the price new is ridiculous)). I have indeed measured a few 50 Hz movement before and was already surprised that worked properly, but the scale doesn't go to even one thousand. How do you read 5400/7200/... rpm? The magnetic spectrum is even worse, going until 50 Hz. Or are you talking about the audio spectrum? I wanna test it now but I don't have hard drives on hand anymore...
- bentcorner 5y ago7200 rpm is 120 hz and 5400 rpm is 90 hz. You should see spikes at these frequencies on the acceleration spectrum tool. The history view makes these spikes very apparent. I'm using a OnePlus 6t and mine goes to 200hz.
- Aachen 5y agoOh! facepalm I'm mixing up "per minute" and per second. Thanks.
- huntertwo 5y agoTangentially related: It's wild what new data can be used for fingerprinting. [1] describes using magnetic signals to fingerprint a device. [2] describes identifying inputted text from CPU interrupt data. I wouldn't be surprised if health data can also be used to fingerprint users, even across devices. I wonder what lower level runtime information (e.g. CPU interrupt data) is available to apps. [1] https://dl.acm.org/doi/abs/10.1145/3319535.3339810 https://dl.acm.org/doi/abs/10.1145/3319535.3339810 [2] https://www.repository.cam.ac.uk/handle/1810/254306 https://www.repository.cam.ac.uk/handle/1810/254306
- hyperstar 5y agoIs the accelerometer of the iphone 5s also sensitive enough to pick up sound?
- wwarner 5y agoHow a microelectromechanical gyroscope works [0]. Contains a spinning disk. 0. https://www.analog.com/en/technical-articles/mems-gyroscope-provides-precision-inertial-sensing.html https://www.analog.com/en/technical-articles/mems-gyroscope-...
- wolpoli 5y agoDoes any one know why do web pages even have access to my accelerometer data without prompt?
- Arete314159 5y agoData point of one: I am disabled and don't move around a ton. When I do walk, I often have a limp. But I don't have MS. Facebook is constantly serving me ads about MS.