3 ms·
> as well as placing markers on its site I suspect what they mean is that requests for the files send an appropriate HTTP status code (e.g. 410 - Gone). This i
by richthegeek 13y ago
> as well as placing markers on its site
I suspect what they mean is that requests for the files send an appropriate HTTP status code (e.g. 410 - Gone). This is standard practice on any website where something is no longer available and is used by search engines to spot dead links.
It's not a request to Google for censorship.
- vidarh 13y agoYou suspect wrong: They added a long list of URLs for their news archives to robots.txt: http://www.computerweekly.com/blogs/public-sector/2013/11/conservatives-erase-internet-h.html http://www.computerweekly.com/blogs/public-sector/2013/11/co... This does not just cause search engines to stop linking to it, but also causes all the main engines to remove it from publicly accessible caches, and causes Internet Archive to remove the pages as well.