56 ms·
Inappropriate Uses of Google Trends
- minimaxir 10y agoIn 2014, Facebook made a famous post (https://www.facebook.com/notes/mike-develin/debunking-princeton/10151947421191849 https://www.facebook.com/notes/mike-develin/debunking-prince...) mocking researchers for using Google Trends data as evidence it would die. I made a comment along the lines of this a year ago (https://news.ycombinator.com/item?id=9828295 https://news.ycombinator.com/item?id=9828295) when people cited Google Trends as statistical evidence people were looking for a Reddit alternative in light of the controversy back then. Google Trends is fun for snarky Tweets, but I'm still seeing it used to prove points in startup blogs, which is a problem.
- huac 10y agoIt's easy for Facebook to say, here's our actual engagement numbers because we have (nearly) perfect tracking! But from an outsider's perspective, say a journalist or a hedge fund bro, it's difficult to perform any truly rigorous analysis involving these unobservable behaviors. So people come up with proxies - Google Trends, polls, or if you're truly adventurous, credit card spend information. [1] Anyways, using products like Google Trends is worth a shot if only because there's few substitutes to imperfect information. [1]: http://www.reuters.com/article/us-sec-capitalone-insidertrading-idUSKCN0UR2KR20160114 http://www.reuters.com/article/us-sec-capitalone-insidertrad...
- minimaxir 10y agoPrinting misleading charts and presenting as fact is often worse than printing nothing at all.
- TeMPOraL 10y agoI wonder how many people do that just to lie to people, because if people believe that Google Trends pseudostatistic, it can become a self-fulfilling prophecy?
- throwanem 10y ago> I wonder how many people do that just to lie to people Ooh, lots, I'm sure. It's a brilliant way to lie, because it makes catching you out look like a lot of hard work.
- lostlogin 10y agoIt's better than the New Zealand Herald (pretty much the national news paper) which regularly resorts to printing Reddit comments in full. Often unattributed.
- dredmorbius 10y agoAs the old Usenet maxim goes, the best way to prompt posting of a true claim is, occasionally, to post a false one. (Doesn't always work. But often does. Or it turns out that the "false" one is justified. Happened to me, once.)
- Smerity 10y agoI'm glad this was written and has more historical examples than just Brexit. I could imagine a good portion of the questions could be originating from students. If a large political or economic event happens, it's not unlikely for classrooms teachers to task their students to understand what's happening. Search is the obvious first step for that. Even more broadly, and in line with the article, extrapolating from a single coarse data point is a Bad Idea™.
- danielweber 10y agoIf you start with the assumption that your enemies are stupid, you won't have much trouble finding the evidence.
- TeMPOraL 10y agoTrue. Also, if Google Trends were for some reason down for the last weekend, journalists would keep looking for "evidence" of stupidity until they found something else.
- venomsnake 10y agoThat also is a great way to lose a political battle. What I observe right now after the Brexit vote is the absolute conviction that brexit happened because the fact that it is xenophobic was just not explained clearly enough and the "stupid" brexiter just did not get it.
- CydeWeys 10y agoForget students even, I'm an adult with a compulsive information-seeking habit, as I suspect a lot of other HN readers are. I know who Harriet Tubman is, but I don't know all there is to know about her, so on the date that her $20 bill debut was announced I Googled her and read parts of her Wikipedia article, the same way I am constantly doing for all sorts of current event topics. How can wanting to learn more possibly be demonized? Would we rather have a situation where a big influential vote affecting the future of an entire nation comes up and no one does any research about it?
- ohitsdom 10y agoGood piece. The conclusion on the Brexit article was ridiculous.
- searine 10y agoYou mean to tell me clickbait media is biased and manipulative? I'm shocked.
- deadalus 10y agoThe Washington Post reporters knew that Google Trends data was not accurate and misleading. They went with it because: it is a liberal site, wanted to make people angry against the Brexit voters. Also Jeff Bezos(the owner) has a beef with Trump and publicly supports liberal media outlets like Gawker. tldr: Nothing unexpected happened, they knew what they were doing.
- th0ma5 10y agoRather than downvote, I'd love to see some links regarding if the Post has a liberal bias, that they knew they were publishing inaccurate and misleading information and did so willingly with intent to deceive, and evidence that they want their readers to be angry against the Brexit votes. I totally agree with your other, factual statements, Bezos I'm sure doesn't care for Trump, and does indeed probably support Gawker. I just can't find anywhere in the world literature any evidence that supports your other claims. Or I guess I wouldn't would I?
- bduerst 10y agoSame here. It's seems to me they're trying to spread F.U.D., but I would love to read more if it's backed up. On the flip side of the coin, some typically conservative media tried to use Google Trends to prove manipulation of instant search results to be pro-Hillary [1], with the same results of not really undestanding how instant search really works [2][3]. [1] http://www.breitbart.com/tech/2016/06/10/google-burying-anti-clinton-search-results/ http://www.breitbart.com/tech/2016/06/10/google-burying-anti... [2] http://www.vox.com/2016/6/10/11903028/hillary-clinton-google-debunked http://www.vox.com/2016/6/10/11903028/hillary-clinton-google... [3] https://googleblog.blogspot.com/2010/09/google-instant-behind-scenes.html https://googleblog.blogspot.com/2010/09/google-instant-behin...
- pessimizer 10y agoNeither the WaPo nor Bezos are "liberal" (unless you mean liberal in the economic sense), but the WaPo is very much anti-Brexit. I agree with you that this was a story constructed to fit their editorial line.
- 10y ago
- joosters 10y agoSimilar-ish to the cancelled 'Google Flu Trends' project, which tried to predict flu outbreaks based on search trends. A paper was initially published, containing fantastic results, but since then the results have not been great: http://www.npr.org/templates/transcript/transcript.php?storyId=289802934 http://www.npr.org/templates/transcript/transcript.php?story... I like the Google quote at the bottom of the article - '...part of the issue was that they sometimes get a flood of searches simply when there's a lot of flu in the news'. Who would have thought of that, eh? It apparently took eight years to discover!
- Buge 10y agoGoogling something does not mean you don't know what it is. Very often I google things that I know quite a bit about. Sometimes to see if there is any news about it, or just to get to the wikipedia page, and brush up on a few facts.
- CM30 10y agoOr in some cases, to 'confirm' that what you think about something is correct or popular. How many of the people searching for the EU stuff were those in both sides looking to validate their own decisions? But yeah, Googling stuff can mean a lot of things, and its ridiculous to assume it purely means someone doesn't know about something.
- ghayes 10y agoTo back this up, I often try to Google in non-biased ways. If you search for "Is paleo unhealthy," you're going to get very different results than "health benefits of Paleo."
- TeMPOraL 10y agoGoogle is indeed rightfully called "the Address Bar of the Internet" in the article. Few of the searches I did today[0]: - russian letters - because I needed to copy-paste a glyph - ramen - because I wanted to double-check this word for one of my today's HN comments - polyvalent - because "wtf does that word in today's HN link mean?" - sabaton prague - to get the name of a song I wanted to listen to - list polecający - to double-check that's a right name in Polish for "recommendation letter" - shield logo - to quickly find an image URL I could post to office chat so that the person who stole my mug can know which mug I'm talking about etc. I could call only one of these (the "polyvalent") a case of not knowing something. Rest were mostly "utility searches". [0] - I'd post more, but for the typical weird Googly reason, they completely fucked up the search history interface - it's now mixed with sites visited with Chrome, of which I have significantly more than distinct Google queries. And there is no way to filter the list. Why Google keeps making interfaces dumber and less usable is beyond me, but I'm started to get sick of it.
- Joeboy 10y agoI'd say the core problem here is that people are insufficiently cynical about plurals. If you see a headline that says "Belgians are going crazy about a roller-blading echidna", you should be asking "How many Belgians?". If there's no answer in the article, the answer is "at least two, maybe". Google Trends is just one of many ways that headline might come to exist.
- ecdavis 10y ago"Which Belgians?" is a similarly important question to ask. I was somewhat surprised by the immediate inference that people searching "what is the EU?" were people who voted to leave, rather than people who voted to stay, or people who didn't vote at all.
- gonedo 10y agovery glad this was written -- the sensationalism of it bothered me
- marcoperaza 10y agoThink about this: the media could concoct this narrative after every single election if they wanted to. They just chose this time because it suited their broader narrative. They're trying to tell you what to think and they're surprisingly effective at it. This should be a wake-up call to thoughtful people everywhere. After this sorry debacle, with all of the major media outlets in the West pushing this ridiculous and spiteful narrative, how can anyone seriously claim that they aren't totally in the bag of certain political interests, that the media isn't pushing a particular world view by spreading lies and deception.
- atarian 10y agoI honestly took the WP article at face value and told a coworker that Brexit voters were regretting their decision based on conclusions drawn from Google trends. I feel like one of those ants that have been infected by the mind control fungus, helplessly infecting others with misinformation designed for an agenda.
- DanBC 10y agoTo be fair, some voters are regretting their decision. Here's the former editor of The Sun (a large uk tabloid "red top") saying he regrets voting leave. http://www.standard.co.uk/news/politics/former-sun-editor-kelvin-mackenzie-admits-remorse-after-voting-to-leave-the-eu-a3281921.html http://www.standard.co.uk/news/politics/former-sun-editor-ke... There are many others, but I link this one because, well, he should have known better.
- deleted 10y ago[deleted]
- marcoperaza 10y agoAnd for the vast majority of people that heard this, it will never be challenged. They will walk on through life believing it is true and never hearing a single reason why it isn't. The WaPo won't run a front page article tomorrow saying "Why we were full of shit".
- cooper12 10y agoIt's called the hivemind; people form a collective intelligence instead of independent narratives. This is partially the fault of news, which is quite opinionated these days, and also our willingness to take these reports at face value and integrate them into our knowledge as Truth. (On the positive face, this is called "word-of-mouth") The cure is skepticism, but you know what they say: "no one likes a skeptic".
- dhimes 10y agoHave you ever googled "What is X" when you knew what "X" was? Neither have I. This article, while a nice caution, doesn't really dismiss the issue. It's not about "oh I look up lots of stuff," it's about lots of people looking up lots of stuff and coincidently with world events a lot of us are looking up this thing having to do with world events. I still don't know who Harriet Tubman is. I haven't googled her yet. I'll probably duck duck go her anyway...but that's a different story.
- stirner 10y ago> Google [is] the Address Bar of the Internet Wouldn't the actual address bar be the address bar of the Internet?
- teamfrizz 10y ago--pedantic
- JadeNB 10y agoFirefox's Awesome Bar (https://support.mozilla.org/en-US/kb/awesome-bar-search-firefox-bookmarks-history-tabs https://support.mozilla.org/en-US/kb/awesome-bar-search-fire...) does its best to blur the distinction. I'm not sure whether theirs or Chrome's came first, but, of course, Chrome does its best to make sure that you see no difference between navigating to a specific address and Googling for it. Certainly I know people who prefer to enter [company name] rather than www.[company name].com in their address bar, and for whom the stop through Google (or whatever search engine of choice) along the way is practically invisible.
- ixtli 10y agoThis is the sort of thing that I like to keep around to link to people when they extrapolate incorrectly from Trends. However the really poor copy editing honestly makes me reconsider this, as a reader. I think the quality of what you read reflects on you and quality is a measure composed of many variables.
- vlunkr 10y agoAny statistical information can be used inappropriately, so it's only logical that it applies to google trends. We seem to be wired as a culture to take stats at face value, myself included. This is a nice cautionary tale.
- NetTechM 10y agoWell written article! I always find it funny when the media claims a majority with their wording when in fact it is an extreme minority. Like those afflicted with H1N1/Bird Flu/zika/ebola etc.. all are dwarfed by people that die every year from the common flu and yet the news portrays them as epidemics to drum up viewers for a week or two.
- deleted 10y ago[deleted]
- piotrkubisa 10y agoReally interesting article, it made me curious how Google Trends would recognize the searches with "Go" and "Golang" since Google now suggests the domain of such phrases (Go was recognized as programming language). As far I know many developers using Go uses "golang" phrase to receive more precise results in search engine, but Google Trends denies such usage of this "trick". I made comparison [1] between the "Go", "Golang", "Elixir", "C#" and I felt pretty amazed that Go phrase is popular the same as C# - I would like to, but I don't think that can be truth. I really suggest to stop using Google Trends as a "representable source" which i.e. programming language is better known (sadly this practice is very popular, even during lectures at colleges/universities or in various publications). [1] https://dl.dropboxusercontent.com/u/26479102/hn/capture_1.png https://dl.dropboxusercontent.com/u/26479102/hn/capture_1.pn... (https://www.google.com/trends/explore#q=%2Fm%2F09gbxjr%2C%20Golang%2C%20%2Fm%2F0pl075p%2C%20C%23&cmpt=q&tz=Etc%2FGMT-2 https://www.google.com/trends/explore#q=%2Fm%2F09gbxjr%2C%20...)
- partiallypro 10y agoLet's face it, the only reason publications turned to Google Trends to show people Googling "What is the EU?" is because it fit the narrative they had out of the gate. I see the good and bad of Brexit (I'd say "remain" has a stronger case if the EU would reform;) yet the more I read from the media, the more I've leaned pro-Brexit, just out of spite. Every article I've read treats those who were pro-Brexit as if they were complete idiots, as if their concerns aren't legitimate. Even if I disagree with someone's policy position doesn't mean I should completely ignore their concerns and write them off as a bunch of idiots. Absolutely infuriating to listen to and read. Maybe it's my imagination, but the media as a whole has gotten a lot more preachy within the past 6 months. The new trend seems to be "data journalism" in which most people omit numbers to the contrary of a certain world view (Vox literally has been getting a dataset from Reddit on 'mass shootings.' Even the NYTs and MotherJones called them out, to no avail. Not sure how people are letting them off the hook.) I honestly can connect more with those that were "Leave" on the E.U. now than in the beginning; simply because the media coverage has come off as so elitist.
- x5n1 10y agoMedia is owned by corporations and the elite. They want freedom of movement, because cheaper labor to exploit and easier to move capital around to make more money. They also want one set of rules and laws and taxes. They also find it much easier to manipulate a single body than multiple bodies. If you want certain policies it's much more effective if you have to buy one government over many different governments. Elite, the few of them that there are, want one world government that allows them to dictate all the policies and tax the population for things like patents and copyright. They want more power and the way to get that is to get everything under one umbrella... or as few umbrellas as possible. It's easier for them to manage their interests that way than if they have to deal with multiple governments all of which represent potentially different power structures and groups.
- fma 10y agoUhmm...I also want freedom of movement. If somewhere else is going to pay me more for the same job, I'm moving there.
- progval 10y agoI believe the “plenty of people” issue is because graphs' vertical scale is not labelled, other than a percentage of the maximum, which says nothing.
- joshvm 10y agoThis is no different from fluff tabloid pieces that say that foods cause cancer. A typical headline might be "Eating chicken every day increases your risk of stomach cancer by 50%!" Unless they specify absolute numbers, this could be a one in 10 million chance increased to 2.5 in 10 million. Or, it could be 4/10 increased to 6/10.
- johansch 10y agoAnd then Iceland beat you. That's gotta hurt.
- hetfeld 10y agoOh,that's really true, but we can just ask random people questions what do they think about EU. I think that majority pro-Brexit answers about EU would be: Illegal immigrants, giving money to Poland and no money for NHS.
- flashman 10y agoI wrote a script that finds pictures of celebrities mentioned on Google Trends, and swaps their faces. Here are Jimmy Fallon and Jada Pinkett Smith: https://twitter.com/faceswapbot/status/731075094739476481 https://twitter.com/faceswapbot/status/731075094739476481 Not entirely sure where this falls on the appropriateness spectrum.
- alphydan 10y agoI don't see the evidence behind this piece. In the article linked it says: << For instance, in the month before the Brexit vote, 8,100 Britons googled “what is the eu.” That’s around 261 a day. Google Trends showed a huge spike in searches for that term the day after the referendum; assuming searches for the term tripled, that’s still fewer than 1,000 individuals googling “what is the eu” in response to the “Leave” victory. >> The key is "assuming searches tripled". Did they triple or did they increase by a 100? All the evidence we get is a line going from zero to a little peak. But without any scale: https://d262ilb51hltx0.cloudfront.net/max/1000/1*mA4iVZVb41Mf0bif-EUCCA.jpeg https://d262ilb51hltx0.cloudfront.net/max/1000/1*mA4iVZVb41M... It seems to be 1/3 of the number of searches for "Game of Thrones". Did only 3,000 people search for Game of Thrones? I went back to google trends and found this: http://imgur.com/zwrWEqB http://imgur.com/zwrWEqB On June 24th, people in the UK searched "Game of Thrones" 1.3x as frequently as "what is the eu". According to Keyword Planner, "Game of Thrones" was searched in May 2.2M times. Approx: 73,000/day. This _could_ mean that "what is the eu" was searched 56,000 times. I like how people get up in arms about the lack of rigour of the other side but forget to check if this piece is likely to be true. Now, whether it was searched by the "Leave" voters, the "Remain", the foreign residents or the people who didn't show up at the poll, that's anybody's guess). edit: June 24th was a day with few "Game of Thrones" searches. So not likely one with an average number of searches, i.e. 73,000. Maybe 35,000? The main point is that everybody accepted the 1,000 searches.
- ferdinandvwyk 10y agoGuilty as charged deletes tweets and learns lesson
- deleted 10y ago[deleted]
- jsonne 10y agoThank you very much for writing this. The staggering smugness I saw, and continue to see, from Reddit threads about how people that voted leave most be slack jawed morons who don't even know what the EU is made me really frustrated. Apparently divisive rhetoric and a sane discourse on politics isn't possible on either side of the aisle (or the Atlantic for that matter.)
- jbergens 10y agoPeople often compare programming language popularity using Google Trends. It could be interesting to analyze those queries more deeply.
- cabalamat 10y agoWhy is Medium blurring out images? It negates the whole point of having images, i.e. to see them.
- epicaricacy 10y agoObviously, anyone who has ever searched "What is love" really has no clue what it is. Thus we can conclude that there is a massive population of sociopaths in our society. /s
- insin 10y agoOr that somebody has successfully cloned an army of Haddaways.
- nkrisc 10y agoEven if you very much know what the EU is, searching "What is the EU" is probably a good start to find a resource that does a good job explaining it in details you didn't yet know.