4 ms·
This is a nice project, but I scrolled this site in hope of finding a download link to the "offline content". I hope this project's goals include creating it.
by Roark66 4y ago
This is a nice project, but I scrolled this site in hope of finding a download link to the "offline content". I hope this project's goals include creating it.
I wonder how big that offline DB will be. PB range?
Also having potentially hundreds servers trying to download entire Internet archive again and again is a recipe for destroying the very resource we so want to preserve. Internet Archive already runs like crap for the majority of time. Imagine how bad it'll get if everyone starts leeching their whole DB.
So in absence of offline archive data this project should have the following features:
- P2p downloading (based on bitorrent perhaps) to avoid redownload ing from the source what can be fetched from online peers.
- ability to mirror live sites and present them (dated) via P2p network where possible.
- ability to buy a hdd with a physical copy of the data.
- nix23 4y ago>I wonder how big that offline DB will be. PB range? I theory ~ 99PB https://archive.org/donate/ https://archive.org/donate/ >>We promise to put your donation to good use as we continue to store over 99 petabytes of data, including 625 billion webpages, 38 million books and texts, and 14 million audio recordings.