3 ms·
Webarchive completely ignores robots for a few years now. They did it on purpose.
by f311a 6y ago
Webarchive completely ignores robots for a few years now. They did it on purpose.
- deleted 6y ago[deleted]
- AnonHP 6y agoI have serious issues with this and the fact that site owners have to email a human support team in archive.org to be excluded.