20 ms·
Audit suggests Google favors a small number of major news outlets
- minimaxir 8y agoImportant caveat: the data analyzed is from November 2017, which is an eternity ago in the SEO world.
- saalweachter 8y ago> IN THE LAST WEEK OF APRIL, nearly 23 percent of all traffic to news sites tracked by web analytics firm Parse.ly came from search engines. Google alone accounts for nearly half of external referral traffic... Is this surprisingly low to anyone else? Depending on how you parse it, only 10% or 20% of news sites traffic comes from Google. When I worked in comparison shopping, 80-90% of our inbound traffic came from Google, as we failed and failed again to cultivate any loyal, direct users.
- jon-wood 8y agoWhen comparison shopping all anyone really cares about is the price, and you're comparing like for like in most cases so Google works really well. News is something where I at least rarely find myself wanting just any old opinion on a story, so I'm more likely to go to a news source that I trust already for their take on that.
- maccard 8y ago? When comparison shopping all anyone really cares about is the price I disagree - people care about delivery times, quality of goods (is it what I ordered), and in some cases, they are open to alternatives (I would like a cheap android phone, If you can give me a Nokia instead of a Huawei, I don't care). Similarly for news, people may have some preferences in their browsing, but ultimately for breaking news it doesn't matter whether it comes from CNN or the India times if there's no opinion involved in it yet, and lets be honest, most short-form journalism has very little research/opinion For long form/blog-like content I agree with you though.
- inetknght 8y ago> When comparison shopping all anyone really cares about is the price While I certainly also care about price: it's not the only thing I care about. I care about length of warranty, user-serviceability and/or ease of return for defect or repair, and reliability. Why should I spend $800 on something that the manufacturer only warrants is useful for 30 days? Why should I spend $80 on something that I can't repair using my own tools? Why should I spend $8 on something that breaks within a week and it's more expensive to return than buy again? I take pride in the things I've acquired. I provide care and maintenance to them. I think only the poorest and/or un-savviest and/or lavish of people worry only about price. > and you're comparing like for like in most cases so Google works really well. I've found that most "marketplaces" provide really poor experiences for customers like me. Amazon is right at the top of the poor experiences. Google Shopping comes next in line. Even something like Newegg will frequently have some pretty iffy deals going on. It makes you (me) really wonder about other "marketplaces" such as the ACA.
- dalore 8y agoWho needs to go to the news site anymore when google shows you the content already? I bet they are losing visits from that. With the other visitors to the news most likely bookmarking their favourite/trusted sites.
- cameronbrown 8y agoBecause headlines are _not_ a substitute for quality journalism and despite falling ad revenue, people will still seek it out to some extent. It's why the EU link tax is a terrible idea - when Google News pulled out of Spain it damaged the online news industry badly[0] with 6-14% drops. [0]https://www.zdnet.com/article/the-google-news-effect-spain-reveals-the-winners-and-losers-from-a-link-tax/ https://www.zdnet.com/article/the-google-news-effect-spain-r...
- C1sc0cat 8y agoAnyone what to tell me who "Parse.ly " are and why I should care.
- deleted 8y ago[deleted]
- vidarh 8y agoFor news I go to a small set of specific sites combined with links from an number of social media sites like Reddit and HN for wider coverage. I think it's very different than comparison shopping - for news what someone you trust considers important and what communities you care about matters. I usually only look at Google if I want to dive into more sources about a specific news item, which is fairly rare, and usually indicates I have reason to mistrust that something is covered properly by my usual sources, or if it's something that for other reasons will not be covered by my usual sources (e.g. let's say some local news item in a location where I don't know what the trusted local media is). For comparison shopping on the other hand, I want to find who can sell me something cheapest - if your site shows up in Google, then I don't have a reason to go to you directly vs. going to Google and getting others too.
- cirgue 8y agoNot really, I would bet that twitter, reddit, facebook, and links from other news-like content generate the lion's share of traffic.
- pixelmonkey 8y agoHey, CTO of Parse.ly here. Might be surprising, but news sites get their traffic from 5 broad categories: (1) search engines (mostly Google in US); (2) social networks (Facebook, LinkedIn, Twitter, Pinterest, etc.); (3) editorial & recirculation (homepage promotion, article-to-article promotion); (4) direct, text, & email, which covers things like WhatsApp and manually shared email links; and (5) the long tail ("other"), which covers things like Google News, Flipboard, blogs, and site-to-site links. These 5 categories are roughly equally split in aggregate traffic -- somewhere between 15-25% per category. You're right that certain kinds of sites, like e-commerce, are heavily weighted toward search -- but this is not broadly or necessarily true for the whole "content universe" of news, information, & entertainment sites, including blogs and so on. Our data reveal all sorts of interesting patterns that go against mainstream assumptions about how people read/watch content online. For example, a measly 1% of traffic to content publishers comes from Twitter, even though Twitter certainly seems like it drives way more than 1% of the conversation, especially in certain categories of content. I wrote about that phenomenon here: https://twitter.com/amontalenti/status/1126913440746962944 https://twitter.com/amontalenti/status/1126913440746962944 If you care to go deeper, one of our data analysts, Kelsey, did a nice deep dive on the different kinds of traffic sources that resonate with different content categories here: https://blog.parse.ly/post/8329/the-14-top-referrer-sources-by-word-count-device-type-and-categories-viewed/ https://blog.parse.ly/post/8329/the-14-top-referrer-sources-...
- mlb_hn 8y agoThanks for posting here pixelmonkey! I had a question; I asked the Parse.ly help/marketing people a while ago if you guys were tracking the rates of invalid traffic on articles and they said you guys don't track it. Is that accurate? Or are there any estimates on how much noise/dirt there is in the data?
- pixelmonkey 8y agoHmm, that's an interesting question, but I'm not sure I fully understand it. By invalid traffic, do you just mean, non-human (bot) traffic? If so, I can say that over time, we have improved our use of bot lists, though that's just an IP blocking thing. Non-human traffic detection is not presently a strong focus of the company, though people have asked us to invest there. The issue is that non-human traffic detection is a somewhat gnarly problem in its own right, with its own vendors (mostly cybersecurity vendors) trying to figure that problem out. We do know we are missing some traffic due to ad/analytics blockers and pi-hole style VPNs, which is fine. One way we have thought about guesstimating "noise/dirt" in the data is to use one of our universally measured metrics, engaged time. So, we could separate really short page sessions from the rest, under the assumption that if a page session is super short, it's either a mindless human click or a JavaScript-enabled bot crawl. I discussed this on our blog awhile back when we did a data study on the subject: https://blog.parse.ly/post/6509/replacing-bounce-rate-with-engagement-rate/ https://blog.parse.ly/post/6509/replacing-bounce-rate-with-e... In that study, we found that 32% of visits to pages were "bad visits" (page session <15s), a pretty high number, but that would include not just bots, but also humans queuing up tabs, Instapaper/Pocket saves, and so on.
- nerdkid93 8y agoSo the large news outlets have better SEO for their articles? I can't say that's very surprising.
- malvosenior 8y agoGoogle could definitely do something to democratize this valuable real estate, but they don't. The question is: Do they keep their left wing bias active due to political alignment, financial incentives or a mix of both?
- the_trapper 8y agoIn their defense the vast majority of mainstream media in the United States is left wing biased. Fox news is pretty much the only major right wing counter balance.
- AlexandrB 8y agoLeft wing biased by US standards. By the standards of the rest of the world, most US outlets are pretty right wing, especially on foreign policy matters.
- malvosenior 8y agoI totally agree. It just shows that even though Google has the potential to break up the mainstream media's near monopoly on narrative creation, they choose not to do it. The dream of the Internet (for me and many others) was the destruction of mainstream media and the creation of platforms that gave individuals and independents a voice. That does exist and is growing in momentum but it's clear that Google is on the side of the mainstream media and their political counterparts.
- jerkstate 8y agoWSJ is also less of the left-wing persuasion than most other mainstream outlets. I’m not sure if I’d call it right-wing but I think many would.
- admax88q 8y ago
- mar77i 8y agoIt's been theorized that these companies are trying to reinstate an "official" narrative for people to follow. https://youtu.be/fQNEu_CTe80?t=467 https://youtu.be/fQNEu_CTe80?t=467 Tim is discussing a comparable process going on on social media in this video, which I see clearly related in this sense. Tinfoil hats out, what Google is being called out for here might be the exact same effort. It sounds like the US propaganda machine is attempting to reclaim the narrative by trying (and failing to) reinvent itself outside cable news.
- thatoneuser 8y agoFollowing politics it certainly appears exactly that way. The news has become a sport of reading both sides and assuming the truth lies somewhere very orthogonal to the information provided.
- toiletfuneral 8y agoThis is incredibly dumb, I’m so sick of qanon dorks
- mschuster91 8y agoWhat I find most interesting is that qanon and other similar crapspiracies have recently upticked here on HN. Used to be lots of ultra-capitalist but socially progressive dominated and free of right-wingers, but ah well, here we are. Eternal September effect in the works?
- IfOnlyYouKnew 8y agoIf you are getting your news from some qanon neckbeard in the woods screaming into his hand held cell phone camera and YELLING IN ALL caps in even his video titles, I can see why you would be disappointed by Google instead choosing reputable media companies.
- macspoofing 8y ago>It's been theorized that these companies are trying to reinstate an "official" narrative for people to follow. You can theorize anything. Doesn't mean it's true. Tim Pool is not the best resource on this either. His default is to provide the most nefarious interpretation of facts on hand ... and in this case he doesn't have evidence for this 'theory'. The problem is that if Google doesn't use major sources then they get accused of propagating 'Fake News' - because non-major news sources tend to be more sloppy and more overtly biased in their reporting. Do you want Breitbart or Infowars to be a news result for political news queries alongside NYTimes and Washington Post?
- zpeti 8y agoThere's an interesting case here of do you manipulate search algorithms for political reasons, or political alignment? The brand value of a lot of left wing brands is higher without question (and I imagine they have more links too), so do you show them more, because, hey, it's just an algorithm... Or do you have to start showing an equal number of left vs right publications? Also, who says what's left or right? How left? How right?
- nicoburns 8y ago> who says what's left or right? How left? How right? It seems pretty pointless trying to adjudicate this. If not for any other reason that what is considered the centre changes over time (e.g. it moved to the left in the post-war years, and back to right in the Reagan/Thatcher years). Furthermore, these changes are arguably a good thing.
- hirundo 8y agoDear Google, I suggest that you embrace this kind of audit in service of transparency and credibility: Create an automated news.google.com/audit page so that readers can easily evaluate the sources and track how they evolve over time. As a user I would also greatly appreciate the ability to toggle news sources on and off, and/or to weight them, and to easily share those filters.
- PedroBatista 8y agoThat would be great, but you are asking for them to incriminate themselves. I don't know about now, but during the Obama administration Google actively participated in spreading narratives. It's not even a secret. Ex: Syria.
- whatshisface 8y ago>during the Obama administration Google actively participated in spreading narratives I haven't heard of that, could you link me to where I could read more?
- PedroBatista 8y agohttps://www.independent.co.uk/life-style/gadgets-and-tech/news/google-syria-rebels-defection-hillary-clinton-emails-wikileaks-a6946121.html https://www.independent.co.uk/life-style/gadgets-and-tech/ne...
- SlowRobotAhead 8y ago>As a user I would also greatly appreciate the ability to toggle news sources on and off, and/or to weight them, and to easily share those filters. IDK. Do we need more ways for users to create bubbles for themselves? Is the solution to avoid Google's preferred bubble just to let you build your own?
- hirundo 8y agoTo mix metaphors, bubbles are essential sanity equipment when drinking from a fire hose.
- lisper 8y agoHeadline should be: Audit suggests Google favors a small number of major NEWS outlets
- IfOnlyYouKnew 8y agoThe list is surprisingly similar to the green box on the media bias charts: https://www.adfontesmedia.com https://www.adfontesmedia.com if you remove the sources with a hard paywall like the WSJ. The only outliers are CNN and FOX, which are probably included simply because they are large, and would tend to cover more of the stories this survey searched for.
- VikingCoder 8y agoIt's not difficult to understand: Google shows users what other users like, and most of Google's current users favor a small number of major outlets. I can appreciate that you may love RC Cola. But it shouldn't surprise you that most gas stations mostly stock Coke and Pepsi products. If you think gas stations need to be more "fair" about which pop they sell, then I'd love to hear you explain how you think that should be done.
- zepto 8y agoUsers often favor what is advertised to them frequently. Google presenting particular results influences users. Pretending that Google is merely passively reflecting user preferences rather than actively shaping them makes no sense.
- VikingCoder 8y agoConsumers favor sodas that are advertised to them frequently, too. We are where we are, because most users have gotten us there. > Pretending that Google is merely passively reflecting user preferences rather than actively shaping them makes no sense. It has content and advertising just like a gas station does. It's a market. Literally, it's a market.
- HBKXNCUO 8y agoYup, a market where Google makes editorial decisions about what ads and results they show.
- traderjane 8y agoIsn’t that just like Safeway or the NYT? Except these companies probably exercise way more control than Google, and their customers likely enjoy the curation.
- HBKXNCUO 8y agoI am sure both of those companies do exercise more control than Google, but they also do not have over 90% market share.
- mola 8y agoThat's a good thing. Too many outlets is chaos Too few is tiraney.
- rcarrigan87 8y agoIf you want a much more interesting read about the few brands that dominate google this article is an excellent breakdown. https://detailed.com/google-control/ https://detailed.com/google-control/
- luckylion 8y agoIsn't this to be expected when you're using links as your primary/major ranking mechanism? The largest companies will have the most links, therefore they'll rank on top, be visible to users, and get more links. Sounds like the Matthew effect, in a way.
- tag_0 8y agoIt seems like a popular response for this kind of this research is “Well of course - I expected this result” or to point out the murky causality going on when an intelligent technology is trained on the behavior of people using it. I agree this murky causality is important to discuss and that indeed these results are consistent with other observed distributions of online content (i.e. Pareto/Zipf), but I think excessively focusing on these responses undermines the importance of audit research like this. Audit research is mainly descriptive by design (can’t really conduct an experiment unless you’re Google) and without the descriptive results from audit research we can’t argue empirically about the these topics at all!
- openfuture 8y agoThere is only one way to make sure that a platform is fair. Make it AGPL. That way there is an information symmetry and even if there is bias there is equal opportunity to exploit it.
- politician 8y agoArguably, the purpose of a search engine is to help people find sources that they don't already know about. Ideally, Google Search should present a diversity of results (the long-term trend of declining search quality, notwithstanding). Google News, however, isn't a search engine, it's a link aggregator curated by a multi-armed bandit that seeks to maximize clicks and minimize political blowback (i.e. via censorship). Providing a diverse set of news sources is inconsistent with these constraints. If it wasn't obvious, Google uses Search to identify topics that reach a large enough audience, and then they build specific properties around those topics curated by algorithms in order to create screen space in which to sell behavior modification products* (ads). While Google News, Maps, and Local are the obvious ones, even AMP fits this model with an attempt to monetize the "waste heat" of the lower click sites by appropriating their content. * gfodor's observation that ads are behavior modification products: https://news.ycombinator.com/item?id=19798178 https://news.ycombinator.com/item?id=19798178
- CoffeeDregs 8y ago> Arguably, the purpose of a search engine is to help > people find sources that they don't already know about. I certainly don't want that... I want a search engine to show me a set of results likely to be most relevant to my query and to my interests. Google does some limited randomization of results to prevent winner-begets-winner outcomes (based on my SERP result research) but they're purpose is certainly not to show people sources that they don't already know about. Most of these queries are basically "navigational" anyways: is someone searching for "trump tariff" looking for interesting results or are they looking to navigate to a story about "trump tariffs"?
- politician 8y agoIf people already know the answers they seek or where to find them, then they aren't using a search engine in the first place. At a fundamental level, the purpose of a search engine it to help people find sources they don't know about. Is Google Search used as an atlas used to navigate the Internet? Almost certainly, but it's not fit for that use case. Google knows this and steers people towards their curated experiences - Maps, News, etc.
- ycombonator 8y agoFahrenheit 451 in real life. Instead of burning books they are suppressing links that don’t favor their political inclinations. Case in point, google ‘the gateway pundit’ https://www.google.com/search?q=the+gateway+pundit https://www.google.com/search?q=the+gateway+pundit and search for the same In DuckDuckGo https://duckduckgo.com/?q=the+gateway+pundit https://duckduckgo.com/?q=the+gateway+pundit find out where they show the actual website.
- mullingitover 8y agoIt's almost as if people were free to publish, or not publish, whatever they want to in America.
- throwawayjava 8y agoI can't figure out what point you're trying to make with those two search results. They are almost equivalent.
- zone411 8y agoSeems pretty clear to me: Google doesn't show the website link in the top 3 results but shows a lot of fact-checking sites in the top 10. It definitely should show the site at #1. The number of fact-checkers shown seems a little excessive but as long as they do something similar for equivalent left-wing sites, I don't have much of a problem with it - The Gateway Pundit publishes a lot of made up bullshit
- throwawayjava 8y agoFor me, the website link is literally the first link on Google.
- zone411 8y agoAh, personalization. It's #4 for me in the incognito mode.
- 8y ago
- GCA10 8y agoBefore we get too deep in arguing about supposed favoritism by Google, let's back up and look at the types of search terms that were entered in this study. Just about all of them relate to the sorts of Washington-focused headline news that's primarily covered by "a small number of major news outlets." Searching for "Rex Tillerson" is the perfect example. (Remember him?) Typical news searchers are looking for a much wider swath of news than just the latest on the former U.S. Secretary of State. In my own experience, that includes local news (what were all those police cars doing last night?) and lots of sports news, business/tech/entertainment news, scientific news, etc. Those articles come from a much wider assortment of news outlets, and I think Google does a decent job of finding them. There's a limit to how many news organizations can generate meaningful coverage about Rex Tillerson. I'm at peace with the idea that Google has found most of the ones that matter.
- writepub 8y agoYou'd be at peace if Google favored news and narratives that overlap with your world view. Hypothetically, how'd you feel if 65% of those articles were from Fox news and the greater Murdoch empire? I wish they simply skipped narrative driven, opinion filth and stayed with factual reporting from AP, Reuters, NPR, ... In the last 5 years, NYT, WaPo,.. have wholly embraced narrative driven opinions instead of sticking with plain news, because anger sells
- doorbellguy 8y agoI would add BBC to that list.
- smt88 8y ago65% of articles in my Google News (not logged in) are from Fox News and/or Washington Examiner. I think geography affects search results a lot. I'm in a blue city, but red state.
- BiasRegularizer 8y agoAre you positive about that? I just tried to VPN from a few different locations in the US (Texas, Georgia and Seattle) with a fresh private browsing session each, all of the headlines appear the same and doesn't change by region.
- amichal 8y agoMany years ago I asked google to provide a “reverse popularity” view for Google News via some customer feedback mechanism. Got back a noncommittal “interesting idea”. I understand it would be hard technically and all the reasons why it doesn’t exist. Still wish it did... are there any interesting solutions to this technically? A “show me stuff I would no normally want/seee” anti filter bubble tech?
- guntars 8y agoIt looks like the impressions follow an exponential (geometric? someone will surely correct me) distribution which is what you would expect if it was based on what people click on. If it was something different where niche outlets were featured more often than their "share", that would imply manipulation and would be a cause for concern.
- cycrutchfield 8y agoPower law is the term you are probably looking for
- kristianc 8y agoThere's a bit of mixing of correlation and causation here. Most reasonable people would consider Google to be an inferior search engine if it surfaced results from the Daily Caller, Kos or Breitbart above those of NPR, BBC and the WSJ. Search engines therefore surface the more authoritative / linked to sources first. These smaller sites are trying to achieve through regulation a level of prominence that they can't get in the marketplace.
- ryanmarsh 8y agoRight, the assumption is that if Daily Caller, Kos, and Breitbart became more popular then Google would surface them as authoritative. First, there's a popular belief amongst their readership (for whatever reason) that this is not the case and that Google actively works against sites like these. Furthermore, if it doesn't currently work against these sites, it's taken for granted that if (for some reason) Zero Hedge became more popular than WSJ Google would work against it. Secondly, if it were the case that Google would surface Zero Hedge over WSJ purely because of popularity is that ok? Is that what should happen? If Google does want to curate rather than using a "blind" algorithm does that change the way it's regulated and what it's responsible for? I think this is something we haven't quite figured out as a free society. We recognize that an educated citizenry is a vital requisite for our survival as a free people (please don't over index on who the quote is attributed to). Yes there are a multitude of media outlets on the internet which the citizenry can use to educate themselves. Are there moral hazards when the majority of the citizenry arrive at one or two doorsteps in-spite of the multitude of alternatives? What is the risk if what's served from that doorstep is detrimental to the republic?
- kristianc 8y ago> Yes there are a multitude of media outlets on the internet which the citizenry can use to educate themselves. Are there moral hazards when the majority of the citizenry arrive at one or two doorsteps in-spite of the multitude of alternatives? What is the risk if what's served from that doorstep is detrimental to the republic? As it turns out, we have figured a lot of this out. It turns out that a good way of deciding what is worth people's attention is to treat a link as a vote. We shouldn't be surprised or alarmed when that surfaces a few main choices, as most of everything is crap. However as happens in almost every sphere of life, there's a good chance that the good stuff rises to the top (that would be that meritocracy that right wingers say they're fond of). Outranking the BBC for news is hard - it should be. What its not for you to decide - even if you do suddenly start to decide to write in the style of John Stuart Mill - is that you like some ideas better than others and that you want to start forcing things on people that they neither want nor asked for in the name of 'balance'
- kilbuz 8y agoPareto suggested this before Audit did.
- mc32 8y agoI’d like to see Google impose a “clickbait” penalty and derank clickbait articles, as long as they are imposing editorial control over content and not simply being a conduit.
- sonnyblarney 8y agoThis is an interesting thing and we can argue about it, but it's a distraction from the fact we have a de-facto 'single source' for a considerable amount of information. Google fits many of the criteria for the definition of monopoly. Once you consider both systematic issues (i.e. Chrome, Android, default browser choices, behavioural things) and even brand and mass-market issues ... it's a monopoly. The control of most information by a single source entity simply is not beneficial to the world, even financially. Google could possibly be broken up, at least the distribution of search entry points should be a different business than search itself i.e. Android/Browser, Search different businesses. Google's control of distribution (i.e. Chrome, Android) is much akin to Standard Oil's control of the railroad system, which was really how they developed their monopoly. Also given the inherent power here, we may want to at least have some regulation on how information is processed. We regulate so many important things, we can require certain things for tech companies as long as they are smart regulations. Edit: put differently we have, without realizing it, put an enormous amount of trust and goodwill into Google - they are 'mostly' doing a good job with it, but there's not reason for us to believe that will continue indefinitely. Though I'm wary of the politicking and sometimes total lack of understanding of this stuff in Congress/Parliament ... at least theoretically we should be able to get past that.
- marcosdumay 8y agoThe largest gain would probably come by splitting the Ad infrastructure out of Google, and forcing it to make their ads available for any search company on the same terms.
- dfilppi 8y agoYeah, Google news is effectively a left wing rag
- freedomben 8y agoA few months ago I was of the opinion that Google was falsely accused of bias and favoring (likely because I tend to agree with their results). However, it's getting easier than ever to test the bias for yourself. I actively wanted to read some of the extreme right wing stuff a few weeks ago, so went searching for it. I've done this with left wing stuff before and it is very easy to find it via Google. (meta comment: I believe strongly that we do everyone a disservice by silencing people. It harms the rest of us by isolated us from anything not "mainstream" and it further pushes the silenced into radicalism and vindicates/bolsters their argument that they are mistreated. So, I try to put myself in uncomfortable territory to see what people are saying, even if it's just to get it from the horse's mouth than spun by somebody in the media or on twitter). I literally could not find it on Google, but just moving over to Duck Duck Go I found what I was looking for right away. You should try it yourself! Think about some polarizing political topic and plug it into Google and then do the exact same search in Duck Duck Go (and maybe Bing, I haven't tried that but I will). You'll be shocked at the difference.
- colordrops 8y agoIt's pretty obvious to those who are paying attention and are not affiliated with a side of the political spectrum that there is a clear bias to Google news and search results. Most though are unwilling to admit this because it implies scary things, such as their world view is wrong, or there are actively malicious people manipulating them, so they concoct narratives as to how these negative behaviors arose organically and unintentionally, and bury comments like yours and mine.
- tzs 8y agoCan you give some specific examples of the searches that did not work on Google but did on DDG?
- freedomben 8y agoYes certainly. I just typed "abortion" into Google and DuckDuckGo and compared the results. Look at the news articles, and "coincidentally" planned parenthood are the top two links. Google: https://www.google.com/search?q=abortion&oq=abortion https://www.google.com/search?q=abortion&oq=abortion DuckDuckGo: https://duckduckgo.com/?q=abortion&t=h_&ia=web https://duckduckgo.com/?q=abortion&t=h_&ia=web DuckDuckGo (news): https://duckduckgo.com/?q=abortion&t=h_&iar=news&ia=news https://duckduckgo.com/?q=abortion&t=h_&iar=news&ia=news
- ChuckMcM 8y agoI certainly felt like Google does this for their 'Google News' product. I selectively blocked half a dozen sources I found to be excessively clickbaity and it really cut into the amount of news that was shown. My guess would be that there are three things going on a least; One is that news outlets are loath to let Google crawl them and post snippets, they argue that Google gets the 'benefit' without paying for the content. (this was used in a couple of lawsuits) One is that Google may provide the advertising feed for news outlets that are shown, thus a double benefit to Google is that you go to their news aggregator, and when you pop off into a news story you continue to be served Google ads. And finally, there is the polarization of people's news intake through a limited number of sources. Per my experiment I found after deleting the new sources I found offenses Google was unable to come up with additional "interesting" news sources, they just didn't crawl them or have access to them (or they don't exist I suppose). Regardless of the reason, the additional wasn't in their index to serve up.
- nmstoker 8y agoInteresting you should say this, as I've found Google News to be "desperately local", to the point of excess. I'm all for regional news and mixing things up, but typically when I've traveled somewhere within the UK perhaps for a weekend, Ithen get inundated with totally inappropriate news from the area for ages, until I proactively block it! Their algorithms can suggest amazing insight at times, but when you suddenly get stuff like "Local council changes bin days in Huddersfield" it's clear they have a long way to go to understand news relevance, especially when you were just passing through.
- tssva 8y agoThe author of this article and the Columbia Journalism Review should be ashamed of themselves. The article uses another study which as the article itself states didn't measure bias in news outlets but instead the self-reported political leanings of those who prefer the news outlets to classify news outlets as left or right leaning. Google may indeed mostly provide links to a few select major news outlets but the article is trying to go beyond this by suggesting a left or right slant to the outlets chosen and therefore to Google using data which doesn't support this.
- ycombonator 8y agoMerchants of "Mainstream"
- Terretta 8y agoWHY SOME NEWS SOURCES DOMINATE ON GOOGLE can be readily answered: From the article: “As much as our results help better describe Google’s curation of news, what our study decidedly cannot say is why some sources dominate on Google. Perhaps some outlets have cracked the SEO code for Top Stories. Or there may be a number of other factors taken into account by Google’s algorithm that end up prioritizing certain outlets over others. We just don’t know unless Google is more transparent with the editorial design and goals of news curation in the Top Stories box.” If you have the question, perhaps you could Google? I cheated on this search, because I recalled something about Google knowing where stories appeared first, and weighting that. Google: how google ranks first to publish news original sources Top result: “Under The Hood: Google News & Ranking Stories” by Danny Sullivan Link: https://searchengineland.com/google-news-ranking-stories-30424 https://searchengineland.com/google-news-ranking-stories-304... Summary: > “Google News tries to determine important story clusters by looking at what individual stories are being featured across the board at various publications. When those publications begin to feature new stories, that in turn influences the creation of new story clusters that get prominent placement at Google News.” And then, the factor I was looking for after seeing the ranks in the “audit” ... who are likely sources of original reporting? > “So what causes an individual article to be the lead item in a particular story cluster? Various factors are involved, Cohen said: ‘The source ranking involves many things. Is there original content? The timeliness. Coverage of recent developments? The relevancy to the cluster at hand. In some cases, is there local relevancy? Is there content from a local source with local content?’” > “Cohen also explained more about the balance between ranking the latest content versus the originating content: ‘Say you publish something and then someone else sources you but adds no real new information. If they come after you, you don’t want to penalize the original source for being first.’” And what is their reputation, aka NewsRank, not PageRank? > “There are source specific rankings, the equivalent of PageRank for a particular site. We look at different third party metrics. What’s the volume of publication of original content in a given category? If you look at Bloomberg and Reuters, they may have hundreds of original articles in business. That’s a pretty good indication of the quality of that source for that category. Compared to sports, there’s not that much original content [and so they might not have as much authority for when ranking sports stories].”
- deleted 8y ago[deleted]
- wuliwong 8y agoI'm not positive but I feel like this is getting mistakenly lumped into the issue of censorship by big tech companies? I could be being naive but this seems like an echo chamber problem that faces websites attempting to surface content to you based on what you like or your network likes. This doesn't appear to me to be same issues of political-based censorship of certain people's accounts that we have been hearing a lot about over the last year.
- BiasRegularizer 8y agoIn machine learning we often use regularizers to reduce bias (amongst many other neat things that it can do), and I've been thinking if similar techniques could be applied to help us humans to reduce bias and strengthen our belief system against malicious information. Some information contain objective facts (e.g. climates change, vaccination), thus citing reputable research is often enough. Though many of the political and economical belief have little objective truth to them (e.g. government regulation, taxation plan), and it is useless to discuss bias, we can only hope to prevent from malicious information. Perhaps allowing both sides to show arguments can help reduce bias, but this technique is far from perfect.
- neilv 8y agoIIRC, the article from the HN post on AMP Stories the other day mentioned the Washington Post as a charter featured participant.
- 40acres 8y agoSpoiler alert: so does everyone else (see subscription numbers). There are a few niche and highly specialized publications which I view (GQ, Men's Health, etc.) but for major news and in depth reporting I'm more likely to frequent WaPo, NYT, Vox, etc. There is a huge drop off in quality when viewing work from the mid-tier news providers.
- winningcontinue 8y agoIt's true, they're the only ones actually putting people on payroll to send them out to areas, do interviews and original investigation. Everybody else is just reaggreggating others from other news outlets, social media and public documents with their own analysis. But even the big mainstream companies suck at local reporting for their own towns. For things that are not national federal news you have to really get it from other people.
- zarriak 8y agoThis is no surprise, the Trump-Russia news story did lots to make Google tighten down and reinforce the major news outlets. A lot of this was documented when it happened when the concern of fake news was at its height, Google intentionally censored many outlets. This is one of the many articles that documented this happening: https://www.truthdig.com/articles/the-silencing-of-dissent/ https://www.truthdig.com/articles/the-silencing-of-dissent/
- drocer88 8y ago“Past events, it is argued, have no objective existence, but survive only in written record and in human memories. The past is whatever the records and the memories agree upon. And since the Party is in full control of all records and in equally full control of the minds of its members, it follows that the past is whatever the Party chooses to make it.” -Orwell
- kartan 8y agoCJR seems not compliant with GDPR. Do they think that the content should be delivered to all the world to read? The big newspapers have taken GDPR seriously as probably other regulations and are safe to be seen around the world or send you to a page were explains why you cannot see the content. Why do so many small companies think that they have the right to sell their content worldwide without following local laws? (To be fair some big companies think the same) "Columbia University and authorized third-party service providers collect information about users’ activities and experiences while visiting a Columbia University website." I do not agree to third parties having my data. Where I can opt-out? Where can I delete my data? Will I be notified if there is a data leak in less than 72 hours of the discovery?
- tj-teej 8y agoCan someone explain why this is any different from the fact that almost every Train Station in the USA has the same couple newspapers available (NYT, WSJ, USA Today, etc.)? If the problem is the monopoly on how people get their news, then shouldn't that be what is solved?
- wuliwong 8y agoThe train station is not algorithmically deciding what to show you. The station has brokered a business agreement with the newspapers in the newsstand. I am unaware of any deal Google has with CNN to make sure a percentage of their articles show up in search engine results.
- yeahitslikethat 8y agoWhat is stopping this from happening? What is stopping Google bombs? What is preventing us from being smarter? From going out and educating ourselves? Thinking more deeply? Finding the truth? Introspecting? Where do we get our thoughts from? Who guides our behavior? There is a struggle going on right now to regain control of the human mind. It used to be just a few major news/media outlets. Now it's the entire world. Someone has to be in charge of the information we are given. Else chaos will consume us all. No one is in charge any more. We have to fix that. People must be told what to think again. They are thinking too many different things to predict the future anymore and that is disconcerting to those in the old power structures.
- samdfonseca 8y agowhat?
- icelancer 8y ago> The train station is not algorithmically deciding what to show you. The station has brokered a business agreement with the newspapers in the newsstand. ....what do you think a business agreement has in it to describe the costs and revenue sharing?
- 8y ago
- peterwwillis 8y ago> As much as our results help better describe Google’s curation of news, what our study decidedly cannot say is why some sources dominate on Google. > News source concentration on Google implies an unequal capture of attention and its benefits, including any advertising or potential subscription revenue that might result. If they are serious about supporting digital-first newsrooms, algorithmic news curators, including Google and others, might be more explicit in articulating the inherent design tradeoffs between the relevance desirable for individuals, the diversity desirable for society or democracy, and the fair competition desirable for news organizations. So, because Breitbart doesn't get as much traffic as CNN, Google must be held accountable?
- Pxtl 8y agoGood. The 21st-century internet has created a crisis of credibility. We've learned that "information wants to be free" and "The Net interprets censorship as damage and routes around it" applies just as well to lies as it does to factual information. We are in a storm of misinformation, and have been for many years. I don't love the 500lb gorillas of mainstream media, but they have skin in the game if they get caught pushing falsehood. Look at men who've trainwrecked their careers over getting caught in a lie - Olbermann, Dan Rather, etc. Can you imagine smaller no-name media sources facing any real consequences in that kind of situation? No. We need credibility again. Until somebody finds a way to algorithmize credibility, I'm happy with saying "only the big boys are assumed to be credible by aggregators".
- StanislavPetrov 8y agoThe problem is that "the big boys" lack just as much credibility in 2019 as anyone else. The fact that they constantly push government narratives doesn't make them any more credible. Google pushing of the "big boy" outlets is an attempt to make them seem more credible.
- Faark 8y agoYou're implying NYT has the same credibility as Infowars. Don't know in what dimension such a statement could be true, but it certainly isn't ours. Also, the current government under Trump despises most of the big boys for obvious reason, so pretending they constantly push government narratives again highlights quite a distorted sense of reality.
- starik36 8y agoNYT certainly doesn't have the same credibility as Infowars, but their name has certainly been tarnished. Just look at Pulitzers awarded for the Collusion story that's been proven to be fake. Or the anti-semitic cartoon they were forced to withdraw last month.
- amanaplanacanal 8y ago
- gdilla 8y agodon't worry. Google's YouTube will happily send you down the right wing rabbit hole of white mail victimhood and climate change is a hoax after you watch a couple of non related videos.
- Angostura 8y agoPresumably major outlets have good Pagerank scores?
- lugg 8y agoMajor traditional news outlets are shown to be major news outlets online. News at 11.. This study is just proving the Pareto principal and claiming its some big thing. Of course these outlets get most of the Google love, they're all linked to as sources by all the little news outlets, how is anyone surprised by this?
- PaulHoule 8y agoIt doesn't seem all that strange to me. The NY Times, Washington Post and the BBC do original reporting. CNN and Fox News have no paywall, and they do something which passes for reporting. Sometimes a regional paper has special coverage of an ongoing story, as the Seattle Times is doing with the Boeing 737 MAX scandal. For each of those there are 100 blogs that are reloading real news sources over and over again and cut-and-pasting a story where the real reporting is "The New York Times reports..."
- james_s_tayler 8y agopeople themselves also tend to favor a small number of major news outlets?