3 ms·
I really lost a lot of respect for the team when I read this page. No matter how good their intentions are, by deliberately ignoring robots.txt they are behavin
by bigstrat2003 1y ago
I really lost a lot of respect for the team when I read this page. No matter how good their intentions are, by deliberately ignoring robots.txt they are behaving just as badly as the various AI companies (and other similar entities) that scrape data against the wishes of the site owner. They are, in other words, directly contributing to the destruction of the commons by abusing trust and ensuring that everyone has to treat each other as a potential bad actor. Dick move, Archive Team.
- akk0 1y agoMind you're reading a 14 year old page. I honestly don't see any value in this being posted on HN.
- rafram 1y agoIt's unambiguously still the official position of the organization. Linked from their FAQ: https://wiki.archiveteam.org/index.php/Frequently_Asked_Questions https://wiki.archiveteam.org/index.php/Frequently_Asked_Ques...