7 ms·

I have family in the industry (digital ads, bidding for ads) and some of the stuff they have explained to me is pretty gnarly. One cousin was explaining an idea

• cj 7y ago
  > they listen to you talking to your wife through your phone about buying a mattress, going to a concert, taking a trip somewhere. Next time you open the browser you are bombarded with relevant ads. I've heard this from non-tech family/friends. Is this actually happening though? If so, who is doing it and how? Edit: I'm referring specifically to ad tech that targets ads based on overheard conversations.
  • crwfshndndls 7y ago
    No, it's not.
  • ourlordcaffeine 7y ago
    I don't know if mainstream apps are doing that, but I don't see why someone couldn't create a "trojan horse" app that requires the microphone, and starts monitoring and sending back recordings if it detects a conversation, it probably would be eventually spotted though if it gets any populartity. Or, perhaps microphones in public that try to tie overheard conversations with beacon or location data to find out who it heard.
  • Tenoke 7y ago
    >Is this actually happening though? If so, who is doing it and how? It's possible but a lot of the reports are clearly coincidences. Take this example of someone watching 'Catch Me If You Can' 2 days ago, and then yesterday seeing a HN posting about the main character and finding it hard to accept as coincidental.[0] 0. https://news.ycombinator.com/item?id=22048337 https://news.ycombinator.com/item?id=22048337
  • MiroF 7y ago
    No, although Google and/or Alexa will build up a profile of your interests based on things you ask/search for through them - but this is the same as with any search engine.
  • grawprog 7y ago
    https://www.popularmechanics.com/technology/security/a14533262/alphonso-audio-ad-targeting/ https://www.popularmechanics.com/technology/security/a145332... Apparently these apps don't record human speech, but the capability's there. https://www.latimes.com/business/la-fi-cameras-grocery-stores-targeted-ads-20190424-story.html https://www.latimes.com/business/la-fi-cameras-grocery-store... Not quite targetting based on conversations but still creepy. I think the targetting based on voice conversations is maybe a bit overblown, but text conversations through messenger or whatsapp, I have no doubt about. There's been more than one time I've started getting targetted ads based on text conversations i've had through those apps. But, I also get targetted ads based on my emails, things I search for on reddit, youtube videos I watch or search for, websites I browse, local ones based on my location, and a myriad of other things that are nearly as bad as my conversations being recorded.
  • at-fates-hands 7y ago
    > Is this actually happening though? If so, who is doing it and how? I think there's a lot of anecdotal evidence that would seem to confirm this. It might seem like they're listening, but it might just be the real-time data collection taking place. If you have an Alexa in your house, it's always on and listening. I have a neighbor who swears when him and his wife are talking about their grocery list, they'll get ads on their phones for the stuff they need. They even tried on purpose to test it out and were talking about getting blinds (they didn't need new blinds) and twenty minutes later they opened Google on their phone and on their desktop PC and they were being served ads for blinds. I had another friend who did the same thing and started talking about how he hated he had to constantly shovel all the snow in his driveway and within minutes was getting ads on his laptop for snow removal services. People will swear Alexa doesn't do this, but the amount of instances I've heard makes me think they can't all be coincidental.
  • mrarjen 7y ago
    It's not proven yet I guess? But then again, the big companies keep saying they don't record/listen to voice commands for assistants either. But the reports of third party companies suddenly having access to this data (for quality improvement purposes) tells another story. Also my YouTube keeps suggesting videos for any show my phone is near when it plays.
    • JackRabbitSlim 7y ago
      Of course they don't record and listen, that would be slow and take huge stores of data. They save transcripts and read/parse it instead. Much faster and less data to store.
    • YeGoblynQueenne 7y ago
      They don't need to listen to your voice for that. The show can have a signal hidden in its sound track that you can't hear, but that the apps on your phone can. Then they can report home that you are watching such-and-such show. No idea what happens after that but I guess google apps share data somehow. There was an article about this that I read a while back, I'll try to find it if I can. Edit: here, found something: https://arstechnica.com/tech-policy/2015/11/beware-of-ads-that-use-inaudible-sound-to-link-your-phone-tv-tablet-and-pc/ https://arstechnica.com/tech-policy/2015/11/beware-of-ads-th... The ultrasonic pitches are embedded into TV commercials or are played when a user encounters an ad displayed in a computer browser. While the sound can't be heard by the human ear, nearby tablets and smartphones can detect it. When they do, browser cookies can now pair a single user to multiple devices and keep track of what TV commercials the person sees, how long the person watches the ads, and whether the person acts on the ads by doing a Web search or buying a product. Edit again: to be fair, not even Facebook and Google have the tech to match the shows you watch with ads just by what your phone hears you say. Speech recognition still doesn't work _that_ well.
  • mh8h 7y ago
    I think, in this case, you underestimate the probability of that happening randomly. The birthday problem [0] can explain that. Imagine you have conversations with your spouse about hundreds of things. And then you see ads about hundreds of things. Sometimes they happen to be about the same things. That's something out of ordinary for you, so you remember that. You are spooked by that, and you might even tweet about it, or tell your friends about it. You don't tweet every time you don't see an ad about the thing you talked about. But the probability of that happening several times over the course of a year is quite high. [0] https://en.wikipedia.org/wiki/Birthday_problem https://en.wikipedia.org/wiki/Birthday_problem
  • s3r3nity 7y ago
    Without doxing myself by giving too much info about myself away, I can say with 99% certainty that this is not happening with Facebook or Apple. The remaining 1% is if policy changed in the past few years (read: < 3 ), or if there was some top-secret team that few knew about working on this. In general, these cases are coincidences based upon one or some combination of the following: 1) Search history that became "subconscious" and the person forgot. Annecdotally, check your history and see if you remember _everything_ you've ever searched for...you may be surprised. Android especially saves more than you might think 2) Related searches or characteristics relevant to the market. Example: during Black Friday in the 'States, many people are searching for TVs, so Amazon or Walmart will probably serve you ads for that in anticipation. Let's say with 10% odds, 1/10 people will see this ad and think "huh - I was just telling my wife we need a new TV. How did they know?" Law of large numbers and such... 3) The person installed malware that IS collecting sound samples, feeding that data to an ad-server, and actually performing this malicious behavior - but it isn't necessarily FB/Apple/etc. You tend to see this more on Android, as the Play Store has too many apps with malware like this, but it can happen on iOS too if the user isn't careful about privacy permissions. Hope that long response helps answer your question =)
    • jka 7y ago
      Your item (3) definitely seems to match the current situation in the wild - FAANG companies are genuinely invested in maintaining their brand and reputation and so I do completely agree that they wouldn't tend to collect seemingly shady or 'underground' data themselves. I think the definition of malware is blurring though. On some websites when I view the list of advertisers & third parties listed in consent dialogs, it's literally hundreds of them. There's no way to tell how many of those are equally motivated to protect user data and be on best behaviour. It's also easy to forget that many users simply don't have the same understanding or reasoning about phone permissions that the audience on HN does. I worry a great deal that we're walking into a world where older generations in particular are exploited by technology via a bombardment of settings and dialog boxes -- and that we're veering away from the real promise of technology, which is to provide clear, simple, fast and effective life improvements.
      • 7y ago
  • giancarlostoro 7y ago
    I partially suspect Facebook since a lot of people I know mindlessly let Facebook Messenger send / read / receive texts. If anybody has evidence to the contrary feel free to let me know. I also suspect anybody using Google Voice is giving up their secrets as well.
  • teh_infallible 7y ago
    Uber spies on passengers using the microphone, I’m willing to bet. I was in an Uber, having a conversation with the driver about wine tasting in Woodenville. When I got home, I had an email from Uber advertising wine tasting trips to Woodenville. The email was sent four minutes after my Uber ride. Coincidence? I found a forum for Uber drivers where someone asked, “Why does the driver app ask to access the microphone?”
    • mattmanser 7y ago
      Do you know how expensive (and shit) voice-to-text is? Go check out AWS Transcribe prices. Try it out too, see how much nonsense it will spew out. It's funny as I've literally just done a project on this to automatically classify phone calls. In reality voice recognition is only good at set phrases, most of Google Assistant and Alexa is smoke and mirrors. It wouldn't even be able to recognise "wine tasting in Woodenville", let alone for it to be economically viable to process every voice like sound in a taxi and make money off adverts. It's just the Baader-Meinhof phenomenon, not Uber recording you.
    • 77pt77 7y ago
      No they don't but due to false allegations from passengers (and to a lesses extent drivers) they plan on starting to record the conversations.
    • esoterica 7y ago
      Did it occur to you that maybe the driver brought up Woodenville because he got the same email before the ride?
    • baddox 7y ago
      I've never heard of Woodenville, but I'd be willing to bet that it's a popular place to go wine-tasting, and that would explain both your conversation and the email advertisement. The exact timing could of course be a coincidence, and not one that seems at all unlikely.
  • umanwizard 7y ago
    I worked at Facebook for four years (three of which on the iOS app) and it's implausible to me that they're using the microphone to listen into people’s conversations, at least on the flagship apps (Messenger, Facebook, Instagram). They'd have to be using some very sophisticated techniques to hide internally that they're doing it, given that engineers can all see the entire codebase. I was pretty intimately familiar with every bit of the build process; it'd have been hard to miss some injection of secret code. Also, the benefit would be minuscule, and the threat to their reputation if caught (given that Zuckerberg has very explicitly claimed not to be doing this) would be huge. I am almost certain that it's not happening on Android either, but I'm not as familiar with that codebase, so I won't claim to know first hand.
    • kaffeemitsahne 7y ago
      Sure, facebook probably doesn't listen to your conversations directly, but I can believe some random free to play game does, and through various data brokers that data can end up with people who advertise on facebook.
    • jacquesm 7y ago
      What does that prove though? Those very same engineers are accessory to all the crap that we do know Facebook has pulled in the past and likely is still pulling in the present. That code doesn't have to be secret at all.
      • deleted 7y ago
        [deleted]
      • celtain 7y ago
        There are quite a few ex-Facebook people who have come out with scathing criticisms of the company, and plenty of Google's internal political fights have spilled out into the media. I'm fairly certain that if this has been happening for years, somebody would have leaked confirmation or publicly admitted to it by now.
    • reaperducer 7y ago
  • rtkwe 7y ago
    It's all anecdotal and so far I don't think anyone has actually found phones etc exporting conversation keywords or anything like that. That being said it's happened a few times that I've been in the car with my girlfriend talking about something, won't search anything about it and we'll get ads about it in the next couple days... The one time that stood out was talking about babies and getting ads about childcare, baby products, etc way more over the next couple days.
  • alkonaut 7y ago
    I think it’s possible that some minor actor is doing it (which I suppose would mean it’s almost certain that someone does it), but it’s likely not done at scale or at a big actor such as Facebook, Samsung or Google. Most people who are creeped out about things like “I talked to my friend about traveling to Aruba yesterday and today on Facebook I have ads for trips to Aruba!” First of all you could have had those ads all year but only noticed after the discussion. That’s the simplest explanation. But also, if this was indeed a friend (or someone who was ever e.g. the recipient of the same email as you, or has friends in common with you etc) then that person perhaps shared that they were in Aruba recently. Since the two of you were in the same location when you talked, a clever advertiser could show you ads for products or services that people they think you interacted with have already bought - such as a hotel stay in Aruba. I’d really like to hear if anyone has first hand experience with spying like this - and the fact that no one has yet come forward and confirmed it suggests it must be rare.
    • saberdancer 7y ago
      Surely it couldn't stay a secret in the industry. Especially as plenty of people spoke up against other questionable practices. Maybe it's like the dieselgate thing where various engineers may not see the big picture, but I honestly do not believe this is the case. I have a strong feeling that for vast majority of people, ads have a significant effect on your purchases, perhaps you were not thinking about traveling to Aruba but after couple of your friends went there, talked to you about and you got bunch of ads showing beautiful Aruba you decided to go. They don't need to listen to you to "get you".
  • selectstatement 7y ago
    I have experienced situations in the past with android which makes me believe that either android itself or an application on android phones is intercepting the plain text values of notifications. I've sent messages to friends through signal about specific things which then started showing up in their google ads the next day. After digging into it we found the recommendation to set signal to no longer preview the messages via notification. Since changing that there's been no further occurrences.
• foxX 7y ago
  Help your family out, make good money from it. The worse it gets, the better. When the shit hits the fan, nobody needs it to come into the headlight with a bang, we want it to become visible with a hypernova.
  • monsieurbanana 7y ago
    The Trump approach, for when you actually need shit to hit the fan.
• edf13 7y ago
  1: Your family have missed the boat - this has been done for the last 5 years. It isn't new 2: It isn't as easy as you (Or they) think. I simple DB isn't going to cope with the real-time needs of the ad industry
  • gfodor 7y ago
    I was at a company doing this in 2004.
  • astura 7y ago
    Five years? More like the last 20+.
• jka 7y ago
  See also companies/products such as Anonos BigPrivacy[0] which claim to provide a software solution which somehow still allows you to perform analytics on user data while magically ticking all privacy compliance laws for you. Pretty hard to interrogate without actually seeing the technical details / implementation, but I strongly suspect this is not really following the intent of regulation (but instead playing a shell game to extract revenue and allow players to navigate through the field for a while until it all unravels). [0] - https://www.anonos.com/company https://www.anonos.com/company
• polynomial 7y ago
  I have fam in adtech and the running joke is "haha, we're the ones doing all the evil stuff you wouldn't believe even if we told you, HHOS."
• munchbunny 7y ago
  I used to work in the space, assembling the DB table you described in a meaningful way is surprisingly hard to do, because you would need to attach confidence intervals to everything you tag onto that user_id. Reality tends to be complex and often wrong, and there are very few actually good signals. That's what makes Facebook such a powerhouse. I eventually left that space for personal reasons, but with distance and time I've resolved that I no longer want to touch that space, no matter the startup idea. I would sooner start developing software to block or push noise into those systems. The digital ad/marketing industry is driven by a lot of people who care about anything but the health of our society or the actual consumers.