6 ms·
> a terrifyingly large amount of history would suddenly blink from existence One response to that is the "The Offline Internet Archive" [0], which includes sof
by tithe 2y ago
> a terrifyingly large amount of history would suddenly blink from existence
One response to that is the "The Offline Internet Archive" [0], which includes software to crawl Internet Archive collections and store them to a local server [1].
[0] https://archive.org/about/offline-archive https://archive.org/about/offline-archive
[1] https://github.com/internetarchive/dweb-mirror https://github.com/internetarchive/dweb-mirror
- xingped 2y agoHow much data does the IA store? If only storage were cheaper, I'd be way more of a digital hoarder.
- RobotToaster 2y agoAccording to their about page, 145+ Petabytes.
- jzb 2y agoI'm gonna need a bigger NAS...
- _flux 2y agoSo apparently a 20 TB HDD can be purchased at around $250, plus perhaps $30 per hdd slot with a computer (I just recall a number of this range from calculating years ago how much it costs to have storage at home), making it 2 million dollars—without any redundancy, so maybe twice that. On the other hand you can already have 24 20TB HDDs for maybe $7000 (with required other hardware), and that's almost 0.5 petabytes. I imagine it would be able to archive all things a single person cares about. Now only if there was a way to interconnect these smaller storage pods to each other..
- speedgoose 2y agoFor the redundancy at this scale, perhaps tape storage is interesting. Though the prices for high density tape seem to not be low enough to be public, and IBM scam their customers by advertising storage capacity before compression.
- IntelMiner 2y agoSo a few racks full of Storinators, and a fat internet pipe I guess
- gcanyon 2y agoI almost can't express how happy this Phineas and Ferb reference makes me.
- IntelMiner 2y agoI don't know what that is
- gcanyon 2y agoNote the -inators here: https://phineasandferb.fandom.com/wiki/List_of_Doofenshmirtz%27s_schemes_and_inventions https://phineasandferb.fandom.com/wiki/List_of_Doofenshmirtz...
- LeoPanthera 2y agoI always thought the physical IA locations like the one in San Francisco should offer a kind of "internet cafe" setup so you can plug into an ethernet port and get gigabit+ downloads without going over the internet at all.
- anticensor 2y agoYeah, IA downloads are notoriously slow. I happen to know because I downloaded archives of a defunct website from IA.
- ghaff 2y agoTo be somewhat diplomatic, how much good does your data hoarding actually benefit anyone but you and maybe some friends? Maybe it will help some leak into the world but the contents of your hard drive are pretty ephemeral.
- xingped 2y agoOh for sure. I don't think of my digital hoarding as anything I'd endeavor to share publicly. I didn't mean to phrase my question in the sense of so I could share what I hoard with others. It was sort of two separate thoughts that yeah, came out sounding like they were attached together.
- __d 2y agoYes, but ... Counter examples exist: the NASA moon landing tapes were lost, but a copy was found in a horde in Australia. Dr Who episodes, lost by the BBC, have been collected from fans' recordings, etc. There's some difficulty in connecting those who want the info with those who have it, but if the search gets enough publicity, it can work. This seems like a problem that could be solved with software.