3 ms·
I was under the impression that archive.org doesn’t respect robots.txt, so in this case they’re the evil ones.
by sotix 3y ago
I was under the impression that archive.org doesn’t respect robots.txt, so in this case they’re the evil ones.
- Springtime 3y agoThat's archive.is not .org which does that.
- Gigachad 3y agoIt does. Even retroactively it will remove things previously cached.