6 ms·

Rupert Murdoch Says Google Is Stealing His Content. So Why Doesn't He Stop Them?

59 points by mjfern 17y ago

gsmaverick 17y ago
I can't believe Google ever paid the AP in the first place. Seems like a bad deal from Google's perspective. They could have easily done without the AP's content.
- uinuibui 17y ago
  AP doesn't compete with Google, they don't run ads. The newspapers do - if the newspapers were to all disappear but AP survived that might be good for an online source of news and ads?
deleted 17y ago
[deleted]
wmf 17y ago
It seems obvious to me that Murdoch et al. want to stay in the Web and be paid rather than de-index and disappear. Given that, these "just use robots.txt" articles seem just as disingenuous as the original statements they're mocking.
- greyman 17y ago
  You was downmoded, but I think you are right. From the article: "go to Google News, or type a newsy topic like "Obama wins Nobel" into Google's search box. What do you get? Headlines and very brief teasers linking to news stories from news sites. If you click on them, you are taken to that news site, where you can read the story, which is surrounded by that site's ads. What, exactly, did Google steal in this scenario?" What exactly did Google steal? Very exactly, Google steal "Headlines and very brief teasers". From the perspective of copyright law, yes, it can be classified as quoting, so they can't sue google, but those "headlines and teasers" do carry news value and in some cases took large amount of resources to produce. Now, Google took it and provided link as a payoff. Is that payoff adequate? Murdoch and many news producers don't think so. Of course, teoretically you can use robots.txt. But in reality you can't, since your competition is also indexed, so you have to play by Google rules, even if you believe they didn't pay you enough for the value they are taking.
  - selven 17y ago
    If you use robots.txt and shut out Google, your news source will fade into obscurity. This is obvious. The conclusion, however, is that by indexing their news sites Google is providing the news sites a service, so if anyone should be paying it's Murdoch.
  - nostrademons 17y ago
    Say that I wasn't happy with the salary that Google is paying me. It's a good salary, but I want more. After all, my labor has already generated more revenue for the company than I am likely to make in my lifetime. I, of course, don't have to work with Google - I can quit at any time. But in reality I can't, since my competition is also willing to work for the same wages and I have to eat. So I have to play by Google's rules, even if I believe they don't pay me enough for the value I am making. Do you have much sympathy for me? Why, then, do you have much sympathy for Rupert Murdoch and his billion-dollar corporation? It's an analogy, and like all analogies, it's imperfect. But it's perhaps more apt than you'd expect. You might argue that I could easily quit and get a job at, say, Yelp or Facebook. But News Corp could easily block Google and form a partnership with Yahoo or Microsoft - heck, there's rumors that they are doing just that. Or you could say that I should quit and form my own business - well, News Corp could easily go hire a crack team of 100 programmers to build their own indexing engine. Except they probably won't find the good ones, since everything indicates that Google is a better place for a computer scientist to work than News Corp. You might also argue that I'm already paid for my labor. Well, News Corp is already paid for the their headlines and their brief teasers: they're paid when people visit their page and advertisers put up money for that privilege. They just want to be paid more. It's not all that different from me wanting a higher salary because I generate far more value to the company than I cost.
    - felixmar 17y ago
      One difference is that you could work for thousands of software companies. In search there's Google and somewhere down the road Bing. Everyone else faces a near impossible road uphill. What if the only places you could work is Google or Microsoft? Do you think you would still get a fair treatment from either?
- joe_the_user 17y ago
  Uh, pointing out that someone else is obviously insincere isn't "disingenuous" (making a false pretense, something Murdoch is doing). They may be hitting an easy target but that doesn't mean they're being insincere in their comments. Also, a lot of people in the "mainstream" may still not fully understand the situation, so sometimes the obvious still needs to be pointed-out.
ramanujan 17y ago
The obvious problem here is that there is an oversupply of news. In an age of electronic worldwide distribution, do you need 938 outlets reprinting the exact same story? No. But that's what you see on Google News. Oversupply means that weeding has to happen. Those outlets that survive will be those that provide unique information (either local news, infotainment, or big budget national/international news). The newspaper as an institution is no more sacred than the Broadway play (which was destroyed by movies) or the family farm (which was automated and scaled up). The only reason many people believe it is somehow different is that a significant fraction of what they read is written by newspaper writers (as opposed to, say, playwrights or farmers).
- timwiseman 17y ago
  You have a good analogy, but the you take it a little too far. Broadway plays have hardly died. From what I hear, they are doing relatively well, and I have watched a number of them as they left broadway and toured into my city at the time. They have fallen somewhat in prominence though. Similarly, family farms have lost their former prominence in society, but they are far from dead. My grandparents ran one until my grandfather retired due to health problems (recently deceased), and even then they leased their land to another family farm nearby. There will be a winnowing in journalism, but this does not mean destruction for any of news, plays, or family farms.
  - ramanujan 17y ago
    Well, by "destruction" what I mean is that 1) In 1850 55% of Americans listed their occupation as farmer or farm laborer. Now it's about 1%. Source here: http://flare.prefuse.org/apps/job_voyager http://flare.prefuse.org/apps/job_voyager 2) Regarding plays (Broadway and elsewhere), they've died in the sense that they represent a much smaller fraction of the entertainment dollar relative to movies.
    - timwiseman 17y ago
      Percentage wise those have both died and you make valid points, but that is hardly death in a true sense. Family farms are still alive and well in many places in America, as are plays, they are just smaller percentages than in the past.
bshep 17y ago
Google could simply remove them from their index for a week, see if a 25% decrease in traffic for a month will make them think twice. I bet that they would change their tune by the the 3rd day and beg google to re-add them. EDIT: Also as someone said further down, google could even charge for their indexing of the news, IMO they are providing a service to the news companies.
- quizbiz 17y ago
  Should Google be able to do that without consequence? I guess they don't because we would go over to Bing.
  - bshep 17y ago
    In theory this is akin to holding someone hostage, but isnt this what the media companies want? I doubt google would ever pay to license the links so the only other option would be to omit them...
  - anamax 17y ago
    > Should Google be able to do that without consequence? What consequence should there be? > I guess they don't because we would go over to Bing. I'll bet that they wouldn't lose much search share and would lose even less search revenue if they ignored a huge fraction of the supposed "news sources". (1) News search isn't huge or lucrative. (2) Most news is "commodity", so it doesn't really matter where you get it from. Cheap distribution (read internet) has put all the commidity news folks in competition with each other, driving prices down. A lot of journalists haven't figured out how that applies to them. Note that Craigslist demonstrated that a huge fraction of newspaper subscribers/buyers weren't buying the paper for the news, but for the ads.
  - skwiddor 17y ago
    Are you sure ? "I just went to google for news and nothing from any of the News International outlets was there, I'm off to Bing!"
rythie 17y ago
I've seen this story repeated a number of times now. Murdoch seems to be obviously wrong to those of us that follow this stuff. I wonder however, if Murdoch is trying to convince the 99% of the public who don't read HN/Techcrunch et all that Google is doing something bad here when he doesn't believe it himself. If not he is simply out of touch.
angusdavis 17y ago
This is off on a tangent from the piece about Google and Rupert, but it's worth noting that in the general discussion of the demise of the traditional print newspaper business, few folks point out that the small community papers are in a better spot. The real issue is that the national and world news has become a commodity that you can get from nearly anywhere. At the same time, the quality of the reporting has declined. Folks like Politico may represent the future of national reporting -- a leaner group of highly talented journalists getting interesting stories out. But why pay to read about some major national news story in paper XXX when you have 1,000 other news sources to read essentially the same content? Conversely, take a look at small community papers. For example, my hometown paper is online at http://bristolri.com/ http://bristolri.com/. These guys are doing just fine (I know the publisher). You can't get their content anywhere else. And you know what? Average everyday people want to read local stories about the new school superintendent, the police report, the controversy over a local land development deal, the letters to the editor from their neighbors, etc. They buy the paper. Local advertisers still advertise. The paper is doing fine, and he's not alone -- lots of small papers are doing OK because their content has not been commoditized. As for Rupert Murdoch, I think he's going in the wrong direction. If I were him, I'd worry less about distribution rights on my essentially worthless commodity national news content, and I would instead set my target on the big ratings agencies. The ratings agencies played a huge role in the credit crisis -- they basically gave bonds a gold star that were, in reality, crap. They should be vulnerable with some sort of new model. There are few companies positioned as well to destroy Moody's as News Corp / WSJ / Dow Jones with their depth of financial industry content / resources / etc. I don't have any idea of exactly what a rating agency 2.0 would look like, but it would seem like a much more productive and valuable place for Rupert to put his focus.
- easp 17y ago
  The other problem the big newspapers chains have is that many of them have substantial debut burdens, which is, again, something a lot of smaller locally owned papers didn't have the privilege or inclination to do.
chrischen 17y ago
I want google to comply and stop linking to AP and Murdoch. See if their revenues increase after less people can find their content.
- easp 17y ago
  Yeah, I think such a move would hurt Murdoch and AP more than it would hurt Google. I understand contextual advertising, I suspect that Google makes far less than average on searches for news related terms, because people aren't looking to buy something, or solve a problem. And while they are at it, they should cut off access to customers on ISPs that are pursuing an anti-net-neutrality agenda. In both cases, I think Google would be better fit out for a war of attrition than their adversaries. On the other hand, Google probably doesn't want to hand Microsoft any opportunities right now by cutting off ISPs.
deleted 17y ago
[deleted]
DomesticMouse 17y ago
First they ignore you, then they laugh at you, then they fight you, then you win.
robryan 17y ago
As many people have said before, you can get reprinted news from everywhere, people will never pay for that kind of news as there will never be a situation where someone doesn't find value distributing in with the advertising model. Investigative journalism and niche long form articles are the way to go, you create an interesting enough website for long form in a niche and people interested in that area will pay (well at least I could justify it).
startingup 17y ago
I think the real debate here is that value in the internet is moving relentlessly away from content producers towards content aggregators. Even a big newspaper site doesn't have the diversity that you find in an aggregator like Google News; likewise, no tech blog can compete with the diversity of news in Hacker News. I visit TechMeme and Hacker News far more than I visit any single blog, for example. TechMeme makes far more money than any professional tech blogger too. Aggregators tend to build much more value to themselves quickly by riding on other people's content. Yet, aggregators are worth nothing without the underlying content. This irks many content producers, particularly the professional ones whose output accounts of the bulk of the traffic that aggregators end up sending. This trend of professionally produced content accounting for the bulk of the links is evident even in Hacker News. If these trends continue, giant aggregators could end up controlling much of the content. Yahoo already produces a lot of content, and licenses content for Yahoo News (which is fitting considering Yahoo News has more traffic than any news site in the world). Google News, Digg etc. could follow. This is the future I suspect Murdoch does not like, because it appears from his perspective to be third parties building value out of his content, without compensating him. Legally, I am not sure he has a claim - if there is a lawsuit on this, it will reach the Supreme Court, that's for sure.
- easyfrag 17y ago
  Exactly. I don't think Murdoch is actually upset that Google drives people to his sites, what bugs him is that they go to Google first. When you read a story in a newspaper, you almost automatically consume other content in that paper, including ads. Why pick up another paper to read more news when it's already in your hands? To a lesser extent the same is true for cable news, you watch a brief segment and you are bombarded with "coming up next" teasers and flashy graphics, pretty anchors, etc., all designed to keep you on that channel (watching ads). The web is way less sticky than even television, sure you could flip channels but you lose context, and you might have to keep flipping to find something interesting, broadcast is a push medium. Contrast this with the web page: what is the easiest thing to do after reading the linked story? Search around the new site (that you may not be familiar with) or hit the back button and resume what you were doing: Pulling down stories you want to read, instead of waiting to see if something interesting comes up. I think Murdoch gets the power of the aggregator, I don't think he understands that he has always pushed content to consumers. (Yes a lot of work goes into creating a brand that attracts these consumers to the paper/network but once they are there they have content pushed to them.) The web is a pull medium. Billions were spent on the "portal wars" of the 90's, and everyone who participated lost to a page with a text box and 2 buttons.
nfnaaron 17y ago
Because he doesn't want his ad salespeople to have to admit to potential advertisers that "well, yes, in fact, we are not findable on google and other search engines."

59 points by mjfern 17y ago

I can't believe Google ever paid the AP in the first place. Seems like a bad deal from Google's perspective. They could have easily done without the AP's content.

uinuibui 17y ago
AP doesn't compete with Google, they don't run ads. The newspapers do - if the newspapers were to all disappear but AP survived that might be good for an online source of news and ads?

deleted 17y ago

[deleted]

wmf 17y ago

It seems obvious to me that Murdoch et al. want to stay in the Web and be paid rather than de-index and disappear. Given that, these "just use robots.txt" articles seem just as disingenuous as the original statements they're mocking.

greyman 17y ago
You was downmoded, but I think you are right. From the article: "go to Google News, or type a newsy topic like "Obama wins Nobel" into Google's search box. What do you get? Headlines and very brief teasers linking to news stories from news sites. If you click on them, you are taken to that news site, where you can read the story, which is surrounded by that site's ads. What, exactly, did Google steal in this scenario?" What exactly did Google steal? Very exactly, Google steal "Headlines and very brief teasers". From the perspective of copyright law, yes, it can be classified as quoting, so they can't sue google, but those "headlines and teasers" do carry news value and in some cases took large amount of resources to produce. Now, Google took it and provided link as a payoff. Is that payoff adequate? Murdoch and many news producers don't think so. Of course, teoretically you can use robots.txt. But in reality you can't, since your competition is also indexed, so you have to play by Google rules, even if you believe they didn't pay you enough for the value they are taking.
- selven 17y ago
  If you use robots.txt and shut out Google, your news source will fade into obscurity. This is obvious. The conclusion, however, is that by indexing their news sites Google is providing the news sites a service, so if anyone should be paying it's Murdoch.
- nostrademons 17y ago
  Say that I wasn't happy with the salary that Google is paying me. It's a good salary, but I want more. After all, my labor has already generated more revenue for the company than I am likely to make in my lifetime. I, of course, don't have to work with Google - I can quit at any time. But in reality I can't, since my competition is also willing to work for the same wages and I have to eat. So I have to play by Google's rules, even if I believe they don't pay me enough for the value I am making. Do you have much sympathy for me? Why, then, do you have much sympathy for Rupert Murdoch and his billion-dollar corporation? It's an analogy, and like all analogies, it's imperfect. But it's perhaps more apt than you'd expect. You might argue that I could easily quit and get a job at, say, Yelp or Facebook. But News Corp could easily block Google and form a partnership with Yahoo or Microsoft - heck, there's rumors that they are doing just that. Or you could say that I should quit and form my own business - well, News Corp could easily go hire a crack team of 100 programmers to build their own indexing engine. Except they probably won't find the good ones, since everything indicates that Google is a better place for a computer scientist to work than News Corp. You might also argue that I'm already paid for my labor. Well, News Corp is already paid for the their headlines and their brief teasers: they're paid when people visit their page and advertisers put up money for that privilege. They just want to be paid more. It's not all that different from me wanting a higher salary because I generate far more value to the company than I cost.
  - felixmar 17y ago
    One difference is that you could work for thousands of software companies. In search there's Google and somewhere down the road Bing. Everyone else faces a near impossible road uphill. What if the only places you could work is Google or Microsoft? Do you think you would still get a fair treatment from either?
joe_the_user 17y ago
Uh, pointing out that someone else is obviously insincere isn't "disingenuous" (making a false pretense, something Murdoch is doing). They may be hitting an easy target but that doesn't mean they're being insincere in their comments. Also, a lot of people in the "mainstream" may still not fully understand the situation, so sometimes the obvious still needs to be pointed-out.

ramanujan 17y ago

The obvious problem here is that there is an oversupply of news. In an age of electronic worldwide distribution, do you need 938 outlets reprinting the exact same story? No. But that's what you see on Google News. Oversupply means that weeding has to happen. Those outlets that survive will be those that provide unique information (either local news, infotainment, or big budget national/international news). The newspaper as an institution is no more sacred than the Broadway play (which was destroyed by movies) or the family farm (which was automated and scaled up). The only reason many people believe it is somehow different is that a significant fraction of what they read is written by newspaper writers (as opposed to, say, playwrights or farmers).

timwiseman 17y ago
You have a good analogy, but the you take it a little too far. Broadway plays have hardly died. From what I hear, they are doing relatively well, and I have watched a number of them as they left broadway and toured into my city at the time. They have fallen somewhat in prominence though. Similarly, family farms have lost their former prominence in society, but they are far from dead. My grandparents ran one until my grandfather retired due to health problems (recently deceased), and even then they leased their land to another family farm nearby. There will be a winnowing in journalism, but this does not mean destruction for any of news, plays, or family farms.
- ramanujan 17y ago
  Well, by "destruction" what I mean is that 1) In 1850 55% of Americans listed their occupation as farmer or farm laborer. Now it's about 1%. Source here: http://flare.prefuse.org/apps/job_voyager http://flare.prefuse.org/apps/job_voyager 2) Regarding plays (Broadway and elsewhere), they've died in the sense that they represent a much smaller fraction of the entertainment dollar relative to movies.
  - timwiseman 17y ago
    Percentage wise those have both died and you make valid points, but that is hardly death in a true sense. Family farms are still alive and well in many places in America, as are plays, they are just smaller percentages than in the past.

bshep 17y ago

Google could simply remove them from their index for a week, see if a 25% decrease in traffic for a month will make them think twice. I bet that they would change their tune by the the 3rd day and beg google to re-add them. EDIT: Also as someone said further down, google could even charge for their indexing of the news, IMO they are providing a service to the news companies.

quizbiz 17y ago
Should Google be able to do that without consequence? I guess they don't because we would go over to Bing.
- bshep 17y ago
  In theory this is akin to holding someone hostage, but isnt this what the media companies want? I doubt google would ever pay to license the links so the only other option would be to omit them...
- anamax 17y ago
  > Should Google be able to do that without consequence? What consequence should there be? > I guess they don't because we would go over to Bing. I'll bet that they wouldn't lose much search share and would lose even less search revenue if they ignored a huge fraction of the supposed "news sources". (1) News search isn't huge or lucrative. (2) Most news is "commodity", so it doesn't really matter where you get it from. Cheap distribution (read internet) has put all the commidity news folks in competition with each other, driving prices down. A lot of journalists haven't figured out how that applies to them. Note that Craigslist demonstrated that a huge fraction of newspaper subscribers/buyers weren't buying the paper for the news, but for the ads.
- skwiddor 17y ago
  Are you sure ? "I just went to google for news and nothing from any of the News International outlets was there, I'm off to Bing!"

rythie 17y ago

I've seen this story repeated a number of times now. Murdoch seems to be obviously wrong to those of us that follow this stuff. I wonder however, if Murdoch is trying to convince the 99% of the public who don't read HN/Techcrunch et all that Google is doing something bad here when he doesn't believe it himself. If not he is simply out of touch.

angusdavis 17y ago

This is off on a tangent from the piece about Google and Rupert, but it's worth noting that in the general discussion of the demise of the traditional print newspaper business, few folks point out that the small community papers are in a better spot. The real issue is that the national and world news has become a commodity that you can get from nearly anywhere. At the same time, the quality of the reporting has declined. Folks like Politico may represent the future of national reporting -- a leaner group of highly talented journalists getting interesting stories out. But why pay to read about some major national news story in paper XXX when you have 1,000 other news sources to read essentially the same content? Conversely, take a look at small community papers. For example, my hometown paper is online at http://bristolri.com/ http://bristolri.com/. These guys are doing just fine (I know the publisher). You can't get their content anywhere else. And you know what? Average everyday people want to read local stories about the new school superintendent, the police report, the controversy over a local land development deal, the letters to the editor from their neighbors, etc. They buy the paper. Local advertisers still advertise. The paper is doing fine, and he's not alone -- lots of small papers are doing OK because their content has not been commoditized. As for Rupert Murdoch, I think he's going in the wrong direction. If I were him, I'd worry less about distribution rights on my essentially worthless commodity national news content, and I would instead set my target on the big ratings agencies. The ratings agencies played a huge role in the credit crisis -- they basically gave bonds a gold star that were, in reality, crap. They should be vulnerable with some sort of new model. There are few companies positioned as well to destroy Moody's as News Corp / WSJ / Dow Jones with their depth of financial industry content / resources / etc. I don't have any idea of exactly what a rating agency 2.0 would look like, but it would seem like a much more productive and valuable place for Rupert to put his focus.

easp 17y ago
The other problem the big newspapers chains have is that many of them have substantial debut burdens, which is, again, something a lot of smaller locally owned papers didn't have the privilege or inclination to do.

chrischen 17y ago

I want google to comply and stop linking to AP and Murdoch. See if their revenues increase after less people can find their content.

easp 17y ago
Yeah, I think such a move would hurt Murdoch and AP more than it would hurt Google. I understand contextual advertising, I suspect that Google makes far less than average on searches for news related terms, because people aren't looking to buy something, or solve a problem. And while they are at it, they should cut off access to customers on ISPs that are pursuing an anti-net-neutrality agenda. In both cases, I think Google would be better fit out for a war of attrition than their adversaries. On the other hand, Google probably doesn't want to hand Microsoft any opportunities right now by cutting off ISPs.

deleted 17y ago

[deleted]

DomesticMouse 17y ago

First they ignore you, then they laugh at you, then they fight you, then you win.

robryan 17y ago

As many people have said before, you can get reprinted news from everywhere, people will never pay for that kind of news as there will never be a situation where someone doesn't find value distributing in with the advertising model. Investigative journalism and niche long form articles are the way to go, you create an interesting enough website for long form in a niche and people interested in that area will pay (well at least I could justify it).

startingup 17y ago

I think the real debate here is that value in the internet is moving relentlessly away from content producers towards content aggregators. Even a big newspaper site doesn't have the diversity that you find in an aggregator like Google News; likewise, no tech blog can compete with the diversity of news in Hacker News. I visit TechMeme and Hacker News far more than I visit any single blog, for example. TechMeme makes far more money than any professional tech blogger too. Aggregators tend to build much more value to themselves quickly by riding on other people's content. Yet, aggregators are worth nothing without the underlying content. This irks many content producers, particularly the professional ones whose output accounts of the bulk of the traffic that aggregators end up sending. This trend of professionally produced content accounting for the bulk of the links is evident even in Hacker News. If these trends continue, giant aggregators could end up controlling much of the content. Yahoo already produces a lot of content, and licenses content for Yahoo News (which is fitting considering Yahoo News has more traffic than any news site in the world). Google News, Digg etc. could follow. This is the future I suspect Murdoch does not like, because it appears from his perspective to be third parties building value out of his content, without compensating him. Legally, I am not sure he has a claim - if there is a lawsuit on this, it will reach the Supreme Court, that's for sure.

easyfrag 17y ago
Exactly. I don't think Murdoch is actually upset that Google drives people to his sites, what bugs him is that they go to Google first. When you read a story in a newspaper, you almost automatically consume other content in that paper, including ads. Why pick up another paper to read more news when it's already in your hands? To a lesser extent the same is true for cable news, you watch a brief segment and you are bombarded with "coming up next" teasers and flashy graphics, pretty anchors, etc., all designed to keep you on that channel (watching ads). The web is way less sticky than even television, sure you could flip channels but you lose context, and you might have to keep flipping to find something interesting, broadcast is a push medium. Contrast this with the web page: what is the easiest thing to do after reading the linked story? Search around the new site (that you may not be familiar with) or hit the back button and resume what you were doing: Pulling down stories you want to read, instead of waiting to see if something interesting comes up. I think Murdoch gets the power of the aggregator, I don't think he understands that he has always pushed content to consumers. (Yes a lot of work goes into creating a brand that attracts these consumers to the paper/network but once they are there they have content pushed to them.) The web is a pull medium. Billions were spent on the "portal wars" of the 90's, and everyone who participated lost to a page with a text box and 2 buttons.

nfnaaron 17y ago

Because he doesn't want his ad salespeople to have to admit to potential advertisers that "well, yes, in fact, we are not findable on google and other search engines."