3 ms·
Too bad just Internet Archive isn't enough, we also need anarchists like ArchiveTeam to actually mirror all the things, not just the things that agree to be mir
by diggan 3y ago
Too bad just Internet Archive isn't enough, we also need anarchists like ArchiveTeam to actually mirror all the things, not just the things that agree to be mirrored.
Internet Archive generally allow websites to control if they get indexed/mirrored or not, via the robots.txt, so websites can decide for themselves.
Luckily, we have other grassroots movements like ArchiveTeam that doesn't care and archives anything deemed valuable to be archived, website owners be damned.
- dredmorbius 3y agoIA have increasingly ignored robots.txt since the mid-2010s, going on at least eight years now: <https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/ https://blog.archive.org/2017/04/17/robots-txt-meant-for-sea...> <https://blog.archive.org/2016/12/17/robots-txt-gov-mil-websites/ https://blog.archive.org/2016/12/17/robots-txt-gov-mil-websi...>
- throw10920 3y ago> Too bad just Internet Archive isn't enough, we also need anarchists like ArchiveTeam to actually mirror all the things, not just the things that agree to be mirrored. No? This is wrong? The site owner is the person who morally decides whether their site should get mirrored or not. It's stuff like this that makes me actively cheer forward otherwise-harmful things like Google's web attestation efforts.
- paul_funyun 3y agoDisagree. They gave up a legitimate moral claim when they posted whatever on the public facing internet.
- throw10920 3y agoThe EU disagrees with you with its "right to be forgotten". Alternatively - you make an excellent case for the paywalling of vast swaths of the internet.