3 ms·
Archive Team routs its collected data to the Internet Archive, with tools that I believe any individual could apply independently. As far as storage, apparently
by Bartweiss 7y ago
Archive Team routs its collected data to the Internet Archive, with tools that I believe any individual could apply independently. As far as storage, apparently the Internet Archive has a $10M budget, which will go quite a long way if you accept slow or even offline storage for the content.
But I'm still not sure how an individual would extract the images fast enough. Archive Team's largest project was ~1.5 petabytes of Google+. In 2012, Imgur had 300M images uploaded, which at 5MB per image would be 1.5PB. Simply keeping up with daily throughput would be an enormous undertaking, much less digging out all of the historical content.
- geggam 7y agoGiven the fact 10 years ago Y! Groups had over 4 Petabytes of data this might be a record for them