3 ms·

> Prime Minister David Cameron’s Conservative Party confirmed a magazine report on Nov. 13 that it had removed from its website speeches that predated the party

> Prime Minister David Cameron’s Conservative Party confirmed a magazine report on Nov. 13 that it had removed from its website speeches that predated the party taking power in 2010, as well as placing markers on its site asking search engines to remove these from their archives. The standard behavior of search engines in such cases should be to remove the entire website from the index. All or nothing.

richthegeek 13y ago
> as well as placing markers on its site I suspect what they mean is that requests for the files send an appropriate HTTP status code (e.g. 410 - Gone). This is standard practice on any website where something is no longer available and is used by search engines to spot dead links. It's not a request to Google for censorship.
- vidarh 13y ago
  You suspect wrong: They added a long list of URLs for their news archives to robots.txt: http://www.computerweekly.com/blogs/public-sector/2013/11/conservatives-erase-internet-h.html http://www.computerweekly.com/blogs/public-sector/2013/11/co... This does not just cause search engines to stop linking to it, but also causes all the main engines to remove it from publicly accessible caches, and causes Internet Archive to remove the pages as well.