4 ms·
It seems with all these website scrapers, we have forgotten about the Internet Archive. http://archive.org/web/ http://archive.org/web/
by imjacobclark 10y ago
It seems with all these website scrapers, we have forgotten about the Internet Archive. http://archive.org/web/ http://archive.org/web/
- johtso 10y agoAnd the fantastic ArchiveBot.. http://www.archiveteam.org/index.php?title=ArchiveBot http://www.archiveteam.org/index.php?title=ArchiveBot
- anc84 10y agoAs awesome as the Internet Archive's Wayback Machine is, it is still under central control. Worse, as they (reasonably) abide to robots.txt rules, the BBC could easily block access to pages they removed at their end in the archive as well. If you care about something, you need to fully "own" it.