A million times this. So much content has been lost and sadly the Internet Archive is not an archive whilst this policy exists which evicts all historical cont

A million times this. So much content has been lost and sadly the Internet Archive is not an archive whilst this policy exists which evicts all historical content when a updated robots.txt is found. I have been for quite some time been donating 1TB-2TB/month of bandwidth in support of Jason Scott and the ArchiveTeam. This has been my way of supporting the Archive.org project and would consider increasing the bandwidth donation in exchange for resolution to the robots.txt bit-rot. I won't link to the leaderboard but for reference I'm currently working on the TwitPic project and am within the top 10; same username as HN.