3 ms·
Every item in the Internet archive has a torrent file served by the Archive. A list of every item can be retrieved. One could, if motivated, build the equivalen
by toomuchtodo 3y ago
Every item in the Internet archive has a torrent file served by the Archive. A list of every item can be retrieved. One could, if motivated, build the equivalent of an ArchiveTeam warrior; instead of grabbing content for archival, you would start up, query for the least available items, retrieve, and then seed the swarm (limited by local disk space available). I maintain a copy of the Internet Archive catalog/item metadata in Backblaze B2, it’s fairly lightweight (comparatively).
You’ll need ~500PB of coordinated decentralized storage to ensure high durability, but can still achieve a somewhat favorable outcome with ~220PB.
- rchaud 3y agoGood to know! Their magazine archive is amazing, so I kay try to maintain a seed for some of those categories.