If you use robots.txt and shut out Google, your news source will fade into obscurity. This is obvious. The conclusion, however, is that by indexing their news s

If you use robots.txt and shut out Google, your news source will fade into obscurity. This is obvious. The conclusion, however, is that by indexing their news sites Google is providing the news sites a service, so if anyone should be paying it's Murdoch.