2 ms·
Are you assuming "people in power" were tied to those situations, though? Specifically, did you check if they were following a robots.txt? I have some critici
by Dylan16807 3y ago
Are you assuming "people in power" were tied to those situations, though? Specifically, did you check if they were following a robots.txt? I have some criticisms for how they handle robots.txt, but if that's the root cause then it paints a very different picture.
- kornhole 3y agoI recall trying to archive a story on a Des Moines local news site. It was publicly available and searchable. I understand people can request of IA not to allow their content to be stored, and there are situations where content is removed on request. Beyond that, it is all opaque to me what goes on there.