2 ms·
In the article there is an example of a blog post that is missing on blog.facebook.com but can be found on web.archive.org. I could be wrong but I think change
by 3xblah 8y ago
In the article there is an example of a blog post that is missing on blog.facebook.com but can be found on web.archive.org. I could be wrong but I think changes to robots.txt can make pages "disappear" from Internet Archive, too. Many have made the mistake of assuming what is at web.archive.org is "permanent" only to watch it "disappear" when the domain name registration lapses and robots.txt changes.
- yellowapple 8y agoI'm surprised the Wayback Machine doesn't account for that by figuring "well our archive of this predates the current robots.txt, so let's not remove it".
- markjgraham 8y agoYou don't need to be surprised. We do account for what you reference.