3 ms·
There should be a way to direct archiving bots to a file that has the newest, compressed version of the website for them to download. Wouldn't that be easier fo
by 6d6b73 10y ago
There should be a way to direct archiving bots to a file that has the newest, compressed version of the website for them to download. Wouldn't that be easier for everyone?
- BHSPitMonkey 10y agoSeems like it would just get abused with false content
- 6d6b73 10y agoTrue, but maybe it would be a good option for non-commercial websites that would like to get archived, and make the archiving more efficient for themselves and archive.org