3 ms·

This might be a good opportunity to mention IA.BAK[1], an effort to back up the Internet Archive. Currently, the entire Internet Archive is stored in one physic

by pfg 10y ago

This might be a good opportunity to mention IA.BAK[1], an effort to back up the Internet Archive. Currently, the entire Internet Archive is stored in one physical space. IA.BAK allows users to store copies of the archive which can be used as a source for data recovery in case of a disaster at this location. [1]: http://archiveteam.org/index.php?title=INTERNETARCHIVE.BAK http://archiveteam.org/index.php?title=INTERNETARCHIVE.BAK

mynewtb 10y ago
'Only' the completely public parts of it though. The archives behind the wayback machine are not publically available, 'just' through their interface. I wish I had the money to host some tens of terabytes for this effort, it's a great idea.
- pfg 10y ago
  Good point. Future versions of the project could theoretically work with encrypted blobs, with the keys (which are significantly easier to keep in multiple physical locations) only known to the Internet Archive. This would probably require some architectural changes to the Archive and might be harder to scale, plus one of the goals of IA.BAK is to not be dependent on any Internet Archive resources other than the actual files. Definitely something to think about down the road, but in the meantime there are plenty of public datasets to back up.