8 ms·
Ask HN: How can this happen without the phone covertly listening?
Yesterday I had my 3rd 'tin foil hat' moment with my iPhone and although these were spread out over some time, I find it very hard to believe these were coincidences.
Long story shortish... yesterday we were sitting around the table enjoying our Easter lunch with extended family. Someone else was mentioning a new family at their church and I caught the first names in passing. At first it didn't click but then I said, 'oh are you talking about X & Y Smith? They used to go to abc church and lived in our neighborhood briefly.' Turns out they were.
Fast forward an hour or so and the kids were playing outside. I took a picture of a friend pushing the kids on the swing and went to send it to the friend. I pressed send, Messages and typed out the first 3 letters of her name. The Messages app showed 2 'autocompletions,' the friend I was intending and the woman I had mentioned an hour before!
- the 3 letters that I typed were NOT in the 'Y Smiths' name!
- my phone was in my pocket when I uttered the name
- I am pretty sure I only said their name once, but could have said it twice
- I have not sent 'Y Smith' a text in at least 4 years
- I have not called 'Y Smith' in at least 4 years
- I was shocked I even had 'Y Smith' contact info in my address book
- I have 'hey Siri' turned OFF
WTF?! How is this possible without the device selectively listening for random words and matching against a profile that includes my address book?
- donahue 4y agoIf you hadn't had that conversation it would not have mattered that she showed up in autocomplete. You would've thought nothing of it. It's only because you had the conversation that the name had any significance. Probably hundreds of times it autocompleted names of people from 4 years ago but since there was no corresponding conversation, you didn't take note and just looked past it.
- RobertRoberts 4y agoThere are far, far too many "coincidences" from many people with this same or similar story.
- Denvercoder9 4y agoFar too many based on what? Consider how many chances there are for stories like this: just about everyone owns a phone, and people share things all time.
- RobertRoberts 4y agoAds based on private conversations is my primary experience. People talk about something, never look it up, never search for it, never try to buy it, but they see ads for it.
- colpabar 4y agoI guess the question then becomes "would that name have shown up if op hadn't said it?" And frankly it seems pretty naive to say that it's only an issue because op noticed it this time.
- cyberge99 4y agoI believe that’s called Bader Meinhoff Phenomenon aka “Frequency Illusion”. https://en.m.wikipedia.org/wiki/Frequency_illusion https://en.m.wikipedia.org/wiki/Frequency_illusion
- Leszek 4y agoOh weird, I was just reading about that.
- joelvalleroy 4y agoWe know.
- DonHopkins 4y ago"Plate of shrimp"
- kornhole 4y agoI didn't know this was the name of the phenomenon. I suspect others looking this up will come across the great movie called The Bader-Meinhoff Complex.
- sameerds 4y agoIsn't it possible that someone else messaged the Smith's about the conversation, and mentioned OP's name, and then some algorithm made the connection?
- MobileVet 4y agoActually, I would have been dumbfounded as to why it was an autocomplete solution. The letters were not an intersection for the second lady's name.
- mdp2021 4y ago> it would not have mattered that she showed up in autocomplete It certainly would, if you cannot figure out why a query returns an apparently fully unrelated record.
- gravypod 4y ago> Someone else was mentioning a new family at their church and I caught the first names in passing Did they happen to add them to their contacts recently or send the X&Y Smiths a message about you?
- jdesmond 4y agoare the letter close on a standard qwerty layout from the intended friend to the "eavesdropped" name?
- Kerbonut 4y agoThere could also be things in the contact like address or other information that it was going off of.
- thepangolino 4y agoCould it be that you had interacted with those contacts in close succession at the time?
- stratosmacker 4y agoDo they also have iPhones? It could be as simple as the Find My network identifying that you'd been near each other (still creepy).
- bequanna 4y agoI am beyond convinced that our phones are hot mics to the point that my wife and I make a conscious effort to move our phones to another room when we have conversations. There have been far too many “anecdotal” examples of me mentioning some thing/product out loud, never searching for anything related to it and then seeing ads for it over the next few days. I resisted the conspiracy theory type explanation but it just occurs too often to be some sort of Baader-Meinhof phenomenon.
- SketchySeaBeast 4y ago> It happens far too often to be some sort of Baader-Meinhof phenomenon (or whatever). Hmmm... is awareness of the Baader-Meinhof phenomena leading to an increase in its own phenomena because one actively tries to disprove it by deliberately noticing an even greater frequency due to their own awareness of it?
- vmception 4y agoOr it’s not that simple and that explanation is only a component of reality, and not the complete reality Lets stop giving these apps a pass. We already know some abuse privileged signing keys to access permissions without asking or a permission is used for other things like third party packages
- SketchySeaBeast 4y agoI wasn't saying that the problem they were having was real or not, I don't have the knowledge for that, I was simply wondering if the vigilance from an awareness of and a desire to disprove the phenemona exacerbates it.
- eminence32 4y agoMy first thought is: this is probably just coincidence. It was just a useless completion that normally would have gone totally unnoticed except for your recent conversation about this person. It seems possible that a phone might be continually listening to background chatter and trying to extract salient/useful pieces of information to then feed into predictive assistants... but honestly that seems like a lot of computational work (especially on a device known for excellent use of its power budget), and a lot of development work. All for a very small incremental improvement in assistant UX that is probably not going to be noticed by most people.
- can16358p 4y agoYour phone might be listening in the background (e.g. Hey Siri needs this to work). Even with the option off (as you said), it might still be processing words on-device for better suggestions. Another non-tinfoil explanation would be cross matching a lot of data from here and there (for example, if you had some event in calender with their names or their name was in some message/text even if you haven't called them for years) and might got its way in there too. There is probably much more going on that I don't even know, too. The point is: while it could be phone listening, it can very well be a result of some huge data processing on your device without listening too. edit: oh, having read the other comments, coincidence/selective bias is even more likely than anything I've written.
- kadoban 4y ago> Your phone might be listening in the background (e.g. Hey Siri needs this to work). Even with the option off (as you said), it might still be processing words on-device for better suggestions. That's _barely_ any better. That's essentially the behavior that's being complained about but implemented a different way.
- shmatt 4y agoThe easiest way to understand this isn't happening is just to hook your phone up to a proxy like Charles, you see all network requests. If speaking automatically triggers some request you'd see it immediately (and see the URL and payload) There was a similar conspiracy when I was in the army, about phones being able to be eavesdropped/wiretapped even when turned off. In short - they can't, but people always believed there was some super secret way to do that
- Wojakmeme 4y agoIt is also possible that the device does not send the data instantly, but rather at a time intervall or bundled with other legit requests.
- ilarum 4y agoTechnically, the scenario described could happen entirely offline: voice recognition, transcription, then match for autocomplete (not that I am claiming this is what happened).
- sovok_x 4y agoFull-text voice recognition is CPU intensive though, so one can expect mobile that's doing that all the time to drain its battery pretty fast in a noisy environment which should be rather obvious.
- kadoban 4y ago> If speaking automatically triggers some request you'd see it immediately (and see the URL and payload) That's one possible way to implement a feature like this. Ruling out this mechanism doesn't rule out any others.
- hammock 4y agoIt could happen offline, it could also happen async.
- Kerbonut 4y agoThey could also queue the data then piggy back it on a “legit” network transaction and since it’s encrypted you’ll never be the wiser.
- casion 4y agoSo you had this person's info in your contacts, and when you started autocompleting a number with a picture of them while you were in the same (geo)location (no less surrounded by other people that know/have this info), the information was autocompleted... and your conclusion is that this is audio data being misused!?
- weird-eye-issue 4y agoOne time I was with some friends and we tested something like this. We chose a random thing I've never purchased, looked at, or have any interest in: "lawnmowers". We put my phone on the table and said lawnmowers a lot, waited a few minutes, then I went to a website I know that has a lot of ads (Notebook Check - not that it matters). Then I scrolled down and waited for an ad to load and it was FOR A LAWNMOWER. I don't even have a lawn!
- mherdeg 4y agoI have in mind a YouTube original tv series hosted by cold reading psychics ("Crossing Over With John Edward") except instead of guessing your grandma's maiden name they just talk about mesothelioma then have the audience open their phones and look for spooky targeted ads.
- vmception 4y agoAn ad and analytics package in any app with enterprise credentials could have this permission (or in an app you authorized to listen for a different reason) And then the data brokers share this with all the other apps Every app creator can honestly say “noo we dont listen wdym” to you, to Congress, to everyone and the analytics package creator and data brokers are going to be laughing for decades
- weird-eye-issue 4y agoThis was a few years, it does make me wonder if I had a malicious app on my phone. Now on Android there is a green light when the mic is on so presumably that would catch this? Unless it is at the OS level
- vmception 4y agoAdditionally, I’ve seen ads served by being on someone else’s home wifi or the same residential wifi together. You get stuff they looked up (or said). I’ve seen it happen in proximity with shared contacts too. Meeting a friend on vacation and they start getting ads about where I live.
- ur-whale 4y ago>How can this happen without the phone covertly listening? Glad to see someone else asking themselves this question, I've found myself in exactly this situation a number of times in recent years.
- ss108 4y agoI've had this experience several times as well. Last time was on a date. We were talking a little bit about board games and tarot cards, and some other third thing . I have never purchased any of the three things or even browsed them on Amazon. Never get ads/recs for those on Amazon, just books. Next day, however, my Amazon recs were all for board games, tarot cards, and whatever the third thing was.
- parksy 4y agoTelemetry is the catch-all phrase used to describe data captured about a device. Telemetry servers combine this information to build profiles on users. Network models of relationships between devices and user behaviours are used in recommendation engines including autocomplete results. If you are in the same room as a cohort of people, if one or more people had been searching or messaging the X & Y Smiths, then by geolocation since you all attend the same church, you're associated as potentially interested, especially considering you already had their details saved. There are also fuzzy logic factors, like maybe those three letters weren't in their name but were in their phone number (each number corresponds to several alphabet characters), or might have been in a message you've long since deleted but is still in your autocomplete index which combined with the geolocation weighting could have caused it to pop up as an option. In these instances it might appear your phone is listening, but you were in the same room as some people who were probably also interested in that family, had their data in your history, and being a new connection could have boosted its relevance too. (I just saw someone else also answered that you probably only noticed this event because of the conversation, or the Baader–Meinhof phenomenon, which is also plausible) Not saying definitively that your phone was not covertly listening but our devices are capturing and correlating a massive amount of dimensions related to our behaviours at all times, so it's not beyond reason that enough of these factors lined up to cause the autocomplete engine to suggest it as a reasonable option.
- MobileVet 4y agoI could definitely believe it was deep telemetry as the intended message recipient did have proximity to the unexpected 'match' earlier in the day. I am 99% sure they hadn't swapped contacts though, so it wouldn't be as easy as a matched contact connection. Interesting idea about the mapping of numbers to letters, oh how I miss 800-call-sal advertisements.
- parksy 4y agoI was reaching on the mapping of numbers to letters to be honest. If I were designing a system to track and corelate everything I'd take it into account since it's still in use, but yeah that was a definite stretch in this case. But I am pretty sure this was just a proximity match. When you're dealing with the quantity of telemetry the big players deal with, you're talking billions of people in real-time all day long, then how do you figure out what's relevant and what isn't? Physical proximity is important. You don't have to swap contacts with someone for your telemetry to connect you with them. I mean you were right next to someone who was right next to them, out of billions of people you're relevant, so no one needs to share contact details. The manufacturer of the phone knows your geolocation. Your telecom company knows your geolocation. If you have bluetooth or wifi switched on and you're already fingerprinted, then every chain store knows your geolocation. If you use a credit card or eftpos card anywhere, the products you purchase are combined into your profile, etc etc. That and you already had them in your contact list (even though you were surprised they were, you're not saying they weren't, I have people in my contact list from 15 years ago I only spoke with one time...), they already know that you've bumped into this contact before in the past, and boost the recommendation because you shared the contact and the geospatial relevance in a short period of time. Like I'm pretty cynical and suspicious at the best of times, but once I started to realise the above, all my "oh shit they're listening" moments kind of dissolved because I could trace all of them back to being in the same room as someone who had met a person, or had been actively searching a related topic in the past few days. Yeah it's still spooky, it's the reason I run a pi-hole, and got myself off most social media. Also I noticed this thread got flagged. Not sure exactly why but I think it's because this same subject has come up a few times. I do think people need to better understand how network analysis can reveal spooky shit about our behaviours, like our devices don't need to be literally listening to our words in order for corporations and governments to know exactly who we are or what we're about. There's tons of different signals we all send out each day that fingerprint exactly who we are, who we're related to, and what we care about, they don't need realtime voice processing.
- j1elo 4y agoSometimes a friend comments on how ugly some car model is in its yellow variant. Then onwards you start realizing that the streets are full of that ugly yellow car !!! How come? Right after bringing some trivial detail into consciousness, there is a period of time where we are more aware about this arbitrary piece of data. Our brain is a pattern-matching machine, so it does the rest. Want to know if it was the iPhone spying on you? Follow the somewhat scientific (ish) method and take note of absolutely all autocomplete suggestions and make a conscious effort to realize how much relevance they had every time. That way you'll learn to differentiate "coincidence" from coincidence.
- LordAtlas 4y agoAh, the Baader-Meinhof Phenomenon.
- djbusby 4y agoDoes the Y Smith name match perhaps by letters from the number pad?
- throwmeariver1 4y agoLegion did a great little PSA about conspiracies and it fits here as well: https://youtu.be/zKYUxOQj5OA https://youtu.be/zKYUxOQj5OA
- mcculley 4y agoThat people can be so oblivious to the ways in which targeted advertising actually works while simultaneously so vulnerable to conspiracy theories about "hot mics" has me worried.
- randomsilence 4y agoDo all participants have iPhones? Apple could have an almost complete social graph. If Y Smith is the common acquaintance between you and your friend, then it would be the best second suggestion if you want to share something in that part of your social graph.
- MobileVet 4y agoYes, there is some potential there... though I am pretty sure the other parties had not swapped contact info yet as they were new and only just met.
- bliteben 4y agoWe need an led for microphone on.
- Kerbonut 4y agoMost likely it would be software based which means how could you trust it? Even if you mandated hardware based they can still conceivably access it after the led via a hardware side channel.
- usrn 4y agoIt's worse: The Analytics tools know so much about you that they can actually predict what you're thinking much of the time. They know the new family went to your church and know you would likely talk about it.
- jgrahamc 4y agoI convinced my wife of the opposite by deciding to talk about a topic we never talk about in front of our phones. She was worried that she was seeing ads for things she'd talked about and I said that it was more than likely that she had searched for similar things and was getting ads based on what she likes. She wasn't convinced. So, we chose X. Neither of us play or follow X in any way. It's not something we'd search for or anything related to it. But we experimented with talking about X and at least one famous Xer that we could name. With our phones on the table. We never received any advertising about X.
- V__ 4y agoI hear the same thing from some of my friends, what do they have in common? They don't block trackers while surfing. Haven't heard it from people who block those. If it were really voice recognition, it shouldn't have an effect on that. I think what most people don't want to admit is how predictable they are and how easy it is to make predictions based on lots of data.
- kaba0 4y agoAnother possible explanation could be that your extended family searched for Y Smith after the event and facebook listed it seeing that you are friends with both. Contrary to others’ experience, I couldn’t reproduce the “talk about X and wait for an ad on X” experiment, I believe it is mostly just the mentioned Frequency illusion, or perhaps some network level thing like A and B talk about something, B later searches for that and “rightfully” get ads on it, and due to A and B’s similar profile or something A also get recommended said product.
- lkxijlewlf 4y agoHappens all the time. The tiny digital versions of you residing on all the servers are a better version of you. So good, they know what you want before you do. Accept that you're being surveilled, accept that you can't do anything about it and don't listen to the people who claim it's a coincidence because they're still connected to the machine.
- sgt101 4y agoDoes anyone believe that this would not be insta leaked by Apple and Google employeed (ex or otherwise?)
- simonw 4y agoDoes your Photos app know who is in the photo you took? Open the image in that app and see if it has identified the people in the photo.
- micromacrofoot 4y agoThis is a mix of confirmation bias and some of the tracking they're actually doing. Audio recording/streaming/processing on this level would be extremely expensive... and they don't even need to do it to essentially end up with the same results. They don't need audio because all they need to do is cross-reference metadata. Facebook for example: they know based on network locations and other factors if your mom spent time in the same church as your neighbor, they don't even have to utter a single word. They actually know about these types of casual relationships between people before they come up in conversation.
- alphabettsy 4y agoFacebook has been doing this for awhile. It’s how they recommend friends that you’ve just met. Sometimes it’s way off, others it’s uncanny.
- micromacrofoot 4y agoI've heard of it kind of filling in the blanks when a spouse suspects an affair
- karthkk 4y agoIt should be easy to run a controlled experiment to test this. Just come up with a few contacts that you have not been in touch with in the last few months, separate them into two groups, control and test. Say out the names of the people in test group to your phone and compare how often you see the names of people in test and control groups in auto complete suggestions and use a statistical test to confirm.
- kornhole 4y agoIt can be very difficult for some people to unwire themselves from IOS. It depends on how important this is to someone. I switched to graphene and FOSS apps a couple years ago. The new level of security and privacy are invaluable to me.
- MobileVet 4y agoHonest question, why was this flagged?
- mdp2021 4y agoYou should now make a number of intentional tests, come back and report.