>Also, FYI they stopped honoring robots.txt directives: https://teleread.org/2017/04/24/the-internet-archive-will-so https://teleread.org/2017/04/24/the-interne

>Also, FYI they stopped honoring robots.txt directives: https://teleread.org/2017/04/24/the-internet-archive-will-so https://teleread.org/2017/04/24/the-internet-archive-will-so... — so if you're a webmaster that would like to exclude your website from the internet archive, you'll have to email them directly to make that request. Good. It shouldn't be as simple as "put a robots.txt on your domain" to erase the entire publicly archived history of any sites ever hosted under that domain. This happened a lot when domains would expire.