3 ms·
Upvoted. That's exactly the problem, and the way to solve it. Example: two months before the movie "The Social Network" got released to theaters in 2010 Facebo
by frik 10y ago
Upvoted. That's exactly the problem, and the way to solve it.
Example: two months before the movie "The Social Network" got released to theaters in 2010 Facebook decided to add a robots.txt to Facebook.com. Immediately Archive.org deleted/disabled access to the archive how Facebook startpage looked in 2004-2010.
BTW. the correct way would be to activate archive access to Facebook.com for the 2004-2010 time-frame again. The "The Accidental Billionaires: The Founding of Facebook" book and the "The Social Network" film based on that book used of course partly Archive.org and various other research methods to get the facts.
- thisacctforreal 10y agoWhat about extending robots.txt to include date ranges? For future domain-owners this is likely far too much control, but maybe that could be mitigated if IA tracks DNS/whois/registration info too
- pimlottc 10y agoIf we did this, the date range would be set to "Forever" 99.99% of the time.