5 ms·
ArchiveTeam also has a project to back up USA governmental data: https://wiki.archiveteam.org/index.php/US_Government https://wiki.archiveteam.org/index.php/US_
by lucb1e 2y ago
ArchiveTeam also has a project to back up USA governmental data: https://wiki.archiveteam.org/index.php/US_Government https://wiki.archiveteam.org/index.php/US_Government
From a quick check, this includes data.gov that the article mentions, as well as www.ncei.noaa.gov ("National Centers for Environmental Information")
From the article:
> we began reaching out and working with partners, eventually coming to call ourselves the Public Environmental Data Partners
...ArchiveTeam has many years of experience scraping and hundreds of people running the Warrior system to contribute data. So much so that they rate limit some of the projects (client-side) to avoid overloading them accidentally. Seems weird not to partner with an organization that will publicly share the data with everyone and is happy to help out, rather than setting up a custom thing that I somehow don't trust to survive the first decade
If you want to help with this effort, see the Warrior's wiki page: https://wiki.archiveteam.org/index.php/ArchiveTeam_Warrior https://wiki.archiveteam.org/index.php/ArchiveTeam_Warrior It's a VM image that you can run on any computer or laptop