8 ms·
Archival Storage
- jewel 2y agoIf you're using cloud storage for backups, don't forget to turn on Object Lock. This isn't as good as offline storage, but it's a lot better than R/W media. At work we've been using restic to back up to B2. Restic does a deduplicating backup, every time, so there's no difference between a "full" and an "incremental" backup.
- 8jef 2y agoMy recipe for large files: 3 copies. Right now, 1st copy on external 8 to 16TB NTFS desktop hard drives, and 2nd copy on 14 to 16TB internal ext4 drives. Theses drives I power up only for copy purposes, once a month or so. At present time, my drives are 5 to 7 years old, and still good. Main working copies I keep on 4 to 8TB NTFS SSDs (mix of sata and nvme), plugged into a PC I'm using regularly, but intermittently.
- 0cf8612b2e1e 2y agoDon’t forget the offsite storage. I try to ship an old copy every year or so to an acquaintance so I have a catastrophic recovery option.
- 8jef 2y agoI'll soon have a remote copy as well..
- jrib 2y agoare you concerned about something like a fire destroying all the copies?
- 8jef 2y agoYes I am, and planning for it.
- lowbloodsugar 2y agoThat’s a lot of work.
- demaga 2y agoYes, exactly. As a data hoarder myself I've been thinking 'what data is _really_ important to me?'. And the answer is - not that much of it. The work, mental space, time, money you have to invest into storing your own data is so much effort, it is probably not worth it.
- overfeed 2y agoI don't consider myself to be a proper data hoarder since I only have tens of TiB at my disposal, but I managed to minimize the work, mental space, and time aspects by automating as much as possible. At first, I had a bunch of scripts running on a raspberry pi, but now I have the entire process managed by Home Assistant. its a rube goldberg machine involving mqtt, VMs, cheap VPSs, rsync, and wifi plugs, but it works. I only get notified if a daily backup fails, and always get full summary of the weeklies. I probably could automate the process of writing to DVD, so the only manual thing I'd need to do would be to insert blank disks, but my quality of life has drastically improved. As for cost, I'm still working on it, and my storage needs are very predictable so I can hunt for deals ahead of time - I still have unused HDDS from last year. It is common to find discounts to about $12/TiB, which is cheap.
- sockaddr 2y agoI'm sure what you rigged up is beautiful, but this sounds stressful haha
- overfeed 2y agoIt helps that I enjoy coding, and that I deeply care about the data I'm preserving. I got burned after losing 2-years worth of unbacked-up data scraped off Twitter right before they closed the API, so I'm never ever going to get that data back again. The backup automation evolved pretty organically, but slowly. I was happy when I finally was able to get the weekly backup process to start automatically.
- hn_throwaway_99 2y agoThis article touches on a lot of different topics and is a bit hard for me to get a single coherent takeaway, but the things I'd point out: 1. The article ends with a quote from the Backblaze CTO, "And thus that the moral of the story was 'design for failure and buy the cheapest components you can'". That absolutely makes sense for large enterprises (especially enterprises whose entire business is around providing data storage) that have employees and systems that constantly monitor the health of their storage. 2. I think that absolutely does not make sense for individuals or small companies, who want to write their data somewhere and ensure that it will be there in many years when they might want it without constant monitoring. Personally, I have a lot of video that I want to archive (multiple terabytes). I've found the easiest thing that I'm most comfortable with the risk is (a) for backup, I just store on relatively cheap external 20TB Western Digital hard drives, and (b) for archival storage I write to M-DISC Bluerays, which claim to have lifetimes of 1000 years.
- deleted 2y ago[deleted]
- nadir_ishiguro 2y agoI personally don't believe an archival storage, at least for personal use. Data has to be living if it is to be kept alive, so keeping the data within reach, moving it to new media over time and keeping redundant copies seems like the best way to me. Once things are put away, I fear the chances of recovering that data steadily reduce over time.
- lurk2 2y ago> Once things are put away, I fear the chances of recovering that data steadily reduce over time. I’ve run into this a lot. You store a backup of some device without really thinking of it, then over time the backup gets migrated to another drive but the device it ran on is lost and can’t be replaced. I remember reading a post years ago where someone commented that you don’t need a better storage solution, you need fewer files in simpler formats. I never took his advice, but I think he might have been right.
- 2y ago
- PaulHoule 2y agoCost calculations are often different at the enterprise scale from the individual scale. Hypothetically https://en.wikipedia.org/wiki/Linear_Tape-Open https://en.wikipedia.org/wiki/Linear_Tape-Open is an affordable storage medium if you need to store petabytes but for what the drive costs https://www.bhphotovideo.com/c/product/1724762-REG/quantum_td_l92an_ey_lto_9_tape_drive_1_2.html https://www.bhphotovideo.com/c/product/1724762-REG/quantum_t... you could buy 400 TB worth of hard drives. Overall I'd have more confidence in the produced-in-volume hard drives compared to LTO tapes which have sometimes disappeared from the market because vendors were having patent wars. Personally I've also had really bad experiences with tapes, going back to my TRS-80 Color Computer which was terribly unreliable, getting a Suntape with nothing at zeros on it, when the computer center at NMT ended my account, the "successful" recovery of a lost configuration from a tape robot in 18 hours (reconstructed it manually long before then), ...
- wmf 2y agoThis is mentioned in the article. There's an old presentation from Google where they mentioned that they were the only ones who read back their tapes to make sure they work.
- sshagent 2y agoMy day job (company died a couple of weeks ago). We had > 100,000 LTO tapes in the end. With data archived way back in 2002 until present. We were still regularly restoring data. In our busiest years we were doing what averaged to 177 restores per day (365 days a year). Barely any physically destroyed tapes. I see a few articles citing robotic failures as a big issue, but really someone can just place a tape in the robot if critical recovery is needed and the robot has died.
- mburns 2y agoWhy not use mdisc and effectively solve the “has my cd/dvd degraded beyond the point of being readable” question entirely.
- rtkwe 2y agoYou may not even be able to get real MDiscs any more [0] and I'm always extremely dubious of 1000 year lifespans since they're effectively impossible to test. [0] https://www.reddit.com/r/DataHoarder/comments/yu4j1u/psa_verbatim_no_longer_sells_real_m_discs_now/ https://www.reddit.com/r/DataHoarder/comments/yu4j1u/psa_ver...
- ndiddy 2y agoFrom the comments of that post: > Hopefully this can put closure to the speculation. Our organization is a databank and is a big user of mdisc for archiving. We reached out to Verbatim last week about this Media Identification Code (MID) discrepancy. Here is their reply, in their own words ---- "The creator of the MDisc technology- Millenniata went out of business in 2017, they sold the technology to Mitsubishi, who until 2019 owned Verbatim. Due to this, the stamper ID changed, but the formula & the disc materials stayed the same. Mitsubishi sold Verbatim & all the technologies to CMC in December of 2020. Verbatim is the only company authorized to sell the original technology. Any Millenniata discs available were all produced before 2017 when the company shut down and any other brand is not the original technology." ----- So there it is, mdiscs with either the 'VERBAT' or 'MILLEN' prefix are fine. Just different production periods. Cheers.
- rtkwe 2y agoAh good catch. One big downside of reddit replacing forums is the default sorting does not make it easy to find late contributions like this.
- wmf 2y agoM-Disc has such low capacity that you'd probably want a robot to burn it which is not cheap.
- rtkwe 2y agoI wish tape archival was easier to get into. But because it's niche and mainly enterprise, drives usually start in the multiple thousands of dollar range unless you go way down in capacity to less than a modern SSD.
- codemac 2y agoNo, it's because of IBM's monopoly. It has little to do with it being enterprise.
- rtkwe 2y agoWhere's their monopoly I see tons of different drive and tape manufacturers. Are they all paying some royalty to IBM for tech?
- markhahn 2y agothere are a couple tape makers, regardless of how many companies rebadge the product. afaik, there are only 2-3 drive makers too. but don't forget that tape doesn't make much sense (in its market) without the robotic library. there might be some off-brands that sell small libraries, but the big ones are, afaik, dominated by IBM.
- rtkwe 2y agoI'm just talking about single drive units you manually swap tapes on. That would still make an excellent long term cold backup for me even if I did have to swap the tape s once a week but they're still 4k+ unless I go all the way down to LTO-5 tapes that are just ~1.5TB which could be good enough for critical things but not really helpful for backing up everything.
- codemac 2y agoYes, they all pay royalties, and all the drives pay licensing for read heads.
- markhahn 2y ago
- xhrpost 2y agoThe quote of LTO tape being much less prone to read failures (10^-20) vaguely reminded me of an old article stating that something like 50% of tape backups fail. I'm not in that side of the industry so can't really comment as to if there is some missing nuance. https://www.quora.com/What-percentage-of-restores-from-a-tape-drive-fail https://www.quora.com/What-percentage-of-restores-from-a-tap...
- codemac 2y agoThe read failures are also attributed to other parts of the system, which for the end user still end up in failed reads. The author links to a sales PDF from Quantum. e.g. the robot dies, the drive dies, the cartridge dies, the library bends, the humidity was too much.. multiplied by each library, robot, drive and cartridge your data is spread across.
- jbverschoor 2y agoOr, a fun little anecdote, the cleaner had access to the server room and turned off the AC of the server room, most disk drives failed, and the tapes melted inside the robots. That was a fun Monday
- dabiged 2y agoLast year my company read in excess of 20,000 tapes from just about every manufacturer and software vendor. For modern, LTO/3592/T10000 era tapes the failure rate we see is around 0.3%. Most of these failures are due to: cartridges being dropped or otherwise physically deformed such that they do not fit into the drives anymore. cartridges getting stuck in drives and destructive extraction being required. Data was never written correctly in the first place. The only exception to this rule that we have seen is tapes written with LTFS. These tapes have a 20 fold higher incidence of failure, we believe because reading data back, as if it was a HDD, causes excessive wear. Anyone claiming 50% failure rates on tapes has no idea what they are talking about, are reading back tapes from the 1970s/80s or have a vested interest in getting people away from tape storage.
- 2y ago
- codemac 2y agoA lot of things are stated as conclusions in this article, where SOTA has reversed or in some cases invalidated the conclusions. Unfortunately they are not published, and will probably remain trade secrets for another decade. The biggest conclusion that is invalidated is that your archival workload cannot be bin packed with your hot workloads. With the ever reducing IO/byte of HDD, this has radically changed where the bytes go.
- codemac 2y agoAnother example is the cost of IO when your backups are not perfectly coalesced. If you're striping writes across datacenters, into objects which are sharded across clusters that encode across many drives - your backups get extremely fragmented. The IO for your backup suddenly becomes HUGE when compared to the size of the end object you wish to read. This makes things like tape nasty - sure you can read at incredible linear speeds.. but that's only worth it if you actually wanted to restore the exact TBs that are on the exact cartridge your drive & robot picked up.
- entrepy123 2y agoIt's kinda mind-blowing that we have (so-called) AI, quantum computing, 6K screens, M2 NVME, billions of networked devices, etc., but regular data *can only be expected to last about 5 years* due to the propensity of moving disk failure, SSD impermanence, bitrot, etc., and is only overcome with great attention and significant cost (continually maintaining a JBOD or RAID or NAS, or painstakingly burning to M-Disc bluray etc.) or handing it over to someone else to manage (cloud) or both. I mean maybe you get lucky with a simple 3-2-1 but maybe you don't, and for larger archives of data that is simply not necessarily a walk in the park either. Absolutely mindblowing.
- pdimitar 2y agoI share your disappointment. I explained it for myself with this: nobody cares if we the netizens have our data backed up. The corps want it for themselves and they face zero accountability if they lose it or share it illegally with others. So it's up to us really. I have a fairly OK setup, one copy on a local machine and several encrypted compressed copies in the cloud. It's not bulletproof but has saved my neck twice now, so can't complain. It's also manual... We the techies in general are dragging our feet on this though. We should have commoditized this stuff a decade ago because it's blindingly obvious the corps don't want to do it (not for free and with the quality we can do it anyway). Should have done app installers for all 3 major OS-es, zero-interaction-required unattended auto-updates -- make is to grandma would never know it's there and it's working. The only thing it asks is access to your cloud storage accounts and it decides automatically what goes where and how (kind of like disk RAID setups I suppose).
- keyringlight 2y agoI think in cases like this "personal computer" is a blessing and a curse. It seems like most of the big parties involved in computing with the big levers to move things are mostly in it for themselves and pick and choose whether they shoulder responsibility for a certain feature, or which side of 'personal' it comes down on with regards to if they hook it into their services and privacy. What would the attitudes be to losing physical information or property be for other parts of our lives versus digital info/property, if that was media, references, financial details, property deeds, old records, etc. While I do appreciate the generosity in how many projects make themselves available (free or otherwise), it does seem like they can have a narrow focus where they solve the challenge they had to solve, but aren't interested going past that point. There's logical reasons for why that happens, but there's unfulfilled potential to make personal computing a better environment there.
- lizknope 2y agoI've got files going back to 1991. They started on floppy and moved to various formats like hard drives, QIC-80 tape, PD optical media, CD-R, DVD-R, and now back to hard drives. I don't depend on any media format working forever like tape. New LTO tape drives are so expensive and used drives only support small sized tapes so I stick with hard drives. 3-2-1 backup strategy, 3 copies, and 1 offsite. Verify all the files by checksum twice a year. You can over complicate it if you want but when you script things it just means a couple of commands once a week.
- gtdawg 2y agoWhat is your process for automating this checksum twice a year? Does it give you a text file dump with the absolute paths of all files that fail checksum for inspection? How often does this failure happen for you?
- lizknope 2y agoI run snapraid once a night and it has a scrub feature to read every file and compare against the stored checksum. https://www.snapraid.it/manual https://www.snapraid.it/manual All my drives are Linux ext4 and I just run this program on every file in a for loop. It calculates a checksum and stores it along with a timestamp as extended attribute metadata. Run it again and it compares the values and reports if something changed. https://github.com/rfjakob/cshatag https://github.com/rfjakob/cshatag These days I would suggest people start with zfs or btrfs that has checksums and scrubbing built in. Over 400TB of data I get a single failed checksum about every 2 years. So I get a file name and that it failed but since I have 3 copies of every file I check the other 2 copies and overwrite the bad copy. This is after verifying that the hard drive SMART data shows no errors.
- gaius_baltar 2y ago> What is your process for automating this checksum twice a year? Backup programs usually do that as a standard feature. Borg, for example, can do a simple checksum verification (for protection against bitrot) or a full repository verification (for protection against malicious modification).
- alnwlsn 2y agoI've thought about the "hundreds of years" problem on and off for a while (for some yet to be determined future time capsule project), and I figure that about all we know for sure that will work is: - engraved/stamped into a material (stone tablets, Edison cylinders, shellac 78s, vinyl, voyager golden record(maybe)) - paper, inked (books) or punched (cards, tape) - photography; microfiche/microfilm (GitHub Arctic Code Vault), lithography? I actually looked into what it might take to "print" an archival grade microfilm somewhat recently - there might be a couple options to send out and have one made but 99.99% of all the results are to go the other way, scanning microfilm to make digital copies. This is all at the hobbyist grade cheapness scale mind you, but it seems weird that a pencil drawing I did in 2nd grade has a better chance of lasting a few hundred years than any of my digital stuff.
- jack_pp 2y agoNot weird at all that a piece of paper you wrote 20 years ago which has like 5-10KB of info that you can decode without any tech can stand the test of time. Archives are hard because of scale, env factors etc.
- aisamu 2y agoYou might be interested in this talk by Will Byrd, of miniKanren fame: Personal Data Preservation, Inspired by Ancient Writing https://ericnormand.me/clojuresync/will-byrd https://ericnormand.me/clojuresync/will-byrd
- simonw 2y agoThat little note half way through this that said "The Svalbard archipelago is where I spent the summer of 1969 doing a geological survey" made me want to know more about the author - and WOW they have had a fascinating career: https://blog.dshr.org/p/blog-page.html https://blog.dshr.org/p/blog-page.html See also https://en.wikipedia.org/wiki/David_S._H._Rosenthal https://en.wikipedia.org/wiki/David_S._H._Rosenthal
- hedgehog 2y agoI met him once at a conference, very interesting guy and funny too.
- _def 2y agoI'm a bit surprised BluRay is not mentioned. It's relatively cheap cold archival storage. Of course the recovery latency is a bit bad because of manual steps, but hey, why not repurpose that old jukebox you have in the garage ;)
- jiveturkey 2y agothe article is about quasi-infinite aka "archival" storage. not decades.
- tiagod 2y agoM-Disk blurays are supposed to last a long time
- jiveturkey 2y agono, only the DVD-R last a long time. the BD-R aren't rated https://news.ycombinator.com/item?id=40240126 https://news.ycombinator.com/item?id=40240126 see other comments in that thread (rooted at parent https://news.ycombinator.com/item?id=40237984 https://news.ycombinator.com/item?id=40237984 ) i can't find an original source but for sure back in that era i read info that the BD-R is not rated. as a data hoarder i ended up not going with that tech due to that analysis. even the main m-disc site only says the BD is "based on" the same tech, not that it was also evaluated. all i can find right now is overwhelmed by marketing and bloggers repeating the not-well-supported 1000 year claim for the BD. anyway, from a bit of googling it appears you can't buy BD version of MDisc any more anyway. The ones marketed as such are apparently the more "normal" HTL BDR which are good for 100 years. https://www.reddit.com/r/DataHoarder/comments/1alz63y/real_mdisc_is_either_47gb_dvdr_or_25gb_bdr_all/ https://www.reddit.com/r/DataHoarder/comments/1alz63y/real_m... seems to be a good analysis, supporting the thought that it's likely only the DVDR that ever met the 1000 year claim.
- tiagod 2y agoThank you for the correction!
- onethumb 2y agoWhile I get that there are use cases for physical media, as both a data hoarder and data paranoiac (good things in my line of work), I've moved on. It's the data that matters, not the media. To that end, I have automated two separate, but complementary, processes for my personal data: - Sync to multiple machines, at least one of which is offsite, in near realtime. This provides rapid access to data in the event of a disk/system/building/etc failure. Use whatever software you want (Dropbox, Resilio, rsync scripts, etc), but in the event of failure, this solves 99% of my issues - I have another device that has fast access to my most recent data, current to within seconds. This is especially important when bringing up a new, upgraded system - just sync over the LAN. (Currently this is 4 devices, 2 offsite, but it flexes up/down over time occassionally). - Backup to multiple cloud providers on a regular cadence (I do hourly encrypted incrementals). This protects me against data loss, corruption, malware attacks, my stupidity deleting something, etc. This solves the remaining 1% of my issues, enabling point-in-time recovery for any bit of data in my past, stretching back many years. I've outsourced the "media" issue to the cloud providers in this case, so they handle whatever is failing, and the cost is getting pretty absurdly cheap for consumers, and will continue to do so. My favorite software is Arq Backup, but there are lots of options. (Currently this is 4 discrete cloud providers, and since this is non-realtime typically, utilizes coldest storage options available). Between these two complimentary, fully automated approaches, I no longer have to worry about the mess of media failure, RAID failures, system failures, human error, getting a new system online, cloud provider being evil, etc etc.
- creer 2y agoYou seem well placed to answer this one: how is cost for this resilience? Compare to the cost of the storage itself? Including the cost of migrating from solutions that are withdrawn from the market?
- onethumb 2y agoThe cost (I assume you're talking about "my time" cost?) is unbelievably low, mostly in part due to good software. It "just works". Specifically, Arq Backup, for example, lets you simply add/remove providers at will. It's happened multiple times, Amazon Drive changed (or went away? I forget...), Google Drive changed their Enterprise policies, etc... No big deal, I just deleted the provider and added another one. I still had plenty of working provider backups, so I wasn't worried while it took a day or two to fill the next provider. (Good argument for having 2+, I'd argue 3+ providers...) Using notifications from your sync apps/systems/scripts/whatever is essential, of course, in case something fails... but all the good software has that built-in (including email and other notifications, not just OS, which helps for remote systems). At this point, it's nearly idiot proof. (Good for idiots like me ;)
- nntwozz 2y agoI basically use the 3-2-1 backup strategy. The 3-2-1 data protection strategy recommends having three copies of your data, stored on two different types of media, with one copy kept off-site. I keep critical data mirrored on SSDs because I don't trust spinning rust, then I have multiple Blu-ray copies of the most static data (pics/video). Everything is spread across multiple locations at family members. The reason for Blu-ray is to protect against geomagnetic storms like the Carrington Event in 1859. [Addendum] On 23 July 2012, a "Carrington-class" solar superstorm (solar flare, CME, solar electromagnetic pulse) was observed, but its trajectory narrowly missed Earth.
- kemotep 2y ago3-2-1 has been updated to 3-2-1-1-0 by Veeam’s marketing at least. At least 3 copies, in 2 different mediums, at least 1 off-site, at least 1 immutable, and 0 detected errors in the data written to the backup and during testing (you are testing your backups regularly?).
- nntwozz 2y agoAll the data is spread across more than 3 sites, both SSDs and Blu-ray (which is immutable). I don't test the SSDs because I trust Rclone, the Blu-ray is only tested after writing. There is surely risk of Bit rot on the SSDs but it's out of sight and out of mind for my use case.
- mindwork 2y agoI've been considering to get in to the Blu-ray backups for a while. Is there a good guide on how to organize your files in order to split it in to multiple backup disks? And how to catalogue all your physical Discs to keep track of them? I remember about 20 years ago my friend had a huge catalogue of 100s of disks with media(anime) and he used some kind of application to keep track of where each file is located across 100s of discs in his collection. I assume that software must have improved for that sort of a thing?
- 2y ago
- CartwheelLinux 2y agoWhen the HDDVD-Bluray wars were going on China had their own implementations of optical storage, and it has been evolving ever since. Much of it is undocumented in languages other than Chinese. Companies in China use these alternative optical discs, some of which store up to 1TB of data. The only reference I can find to it on English Wikipedia is the CBHD https://en.wikipedia.org/wiki/China_Blue_High-definition_Disc https://en.wikipedia.org/wiki/China_Blue_High-definition_Dis...
- sigio 2y ago1TB would be nice, but never heard of these, and the quoted wikipedia page lists: Like HD DVD, CBHD discs have a capacity of 15 GB single-layer and 30GB dual-layer and can utilize existing DVD production lines. So sounds relatively equivalent to bluray, which is way to small to backup modern HDD's (10TB+)
- lyu07282 2y agoit's actually 128GB per disk (BDXL), I only know of Chinese companies announcements of 500GB optical disks last year[1], not sure if they are already deployed to some enterprise partners, it's entirely possible. Their more theoretical research goes far beyond that. [2] There are archival storage machines similar to tape drive robots for archival storage in the Chinese market where you have hundreds of such disks in a single unit and 1PB+ per rack. [1] https://mp.weixin.qq.com/s/dU8QdK8w8f5qziWP0UYQuw https://mp.weixin.qq.com/s/dU8QdK8w8f5qziWP0UYQuw [2] https://www.theregister.com/2024/02/23/optical_disc_breakthrough/ https://www.theregister.com/2024/02/23/optical_disc_breakthr...
- swyx 2y agois the talk recorded/live somewhere? anyone from berkeley?
- squeedles 2y agoSimple wins. Always. I've backed up on just about everything going back to QIC-150s, but today I just use a set of 4Tb drives that I rsync A/B copies to and rotate offsite. That gives me several generations as well as physical redundancy. The iteration before that, I made multiple sets of Blu-Rays, which became unwieldy due to volume, but was write-once with multiple physical generations. I miss that, but at one point I needed to restore some files and even though I used good Verbatim media, a backup from a couple months prior was unreadable. All copies had a mottled appearance and the drive that wrote it (and verified) was unable to read it. Did finally find a drive that would read it, but finally pushed me over the edge. I wonder how the author's 18yo media will compare to modern 5yo media. It's been a long time since we have had the rock solid Taio Yuden gold disks ...
- wuschel 2y agoThis made me smile. I have a very similar configuration. Simple but effective. The only thing that worries me bitrot might get me. Then again, my body will bitrot, too. So no point worrying too much about some random data in some turbulence in time.
- markhahn 2y agoCan anyone provide comments on LOCKSS? I found https://www.lockss.org/use-lockss/how-lockss-works https://www.lockss.org/use-lockss/how-lockss-works but it's really written for library/RDM types, not sysadmins/architects. https://github.com/lockss https://github.com/lockss and https://docs.lockss.org/projects/manual/en/latest/introduction/index.html https://docs.lockss.org/projects/manual/en/latest/introducti... don't obviously lead me to any papers on things like UBER, etc. The reason I ask is because LOCKSS seems to take seriously the notion that data isn't really there unless you have checked it recently.
- lvl155 2y agoOT but what’s current in terms storing data in space ie on the moon or elsewhere within the solar system?
- jandrese 2y agoSeems like a bad idea. Not only is it incredibly expensive to get there, but tremendously inconvenient when you need to restore from that backup. Also, lots of high energy interstellar particles bombarding your media. You'd be better off filling a chamber with an inert gas at the bottom of a mine and sealing it up. Still inconvenient as hell to access, but you're much better protected against most disasters.
- UltraSane 2y agoLTO tape is excellent for archival storage because that is what it was designed for. It uses a two layer error correction code that means it has an incredibly low bit error rate so you will still be able to read a tape that was stored correctly 40 years later. Just remember to also store a compatible drive!
- damnitbuilds 2y ago"It is backed up to a Raspberry Pi, also on the DMZ network but not directly accessible from the Internet." I find it strange that a discussion of storage talks about backing things up to a Raspberry Pi, as if that means anything.
- globular-toast 2y agoThis article is specifically about digital archival. That is, keeping bit-perfect copies of data for 100+ years. But I think for regular people this is not so obviously useful. People want to keep things like texts (books), photographs, videos etc. Analogue formats are a much better option for these things, for a couple of reasons: * They gracefully degrade. You don't just start getting weird corruption or completely lose whole files when a bit gets flipped. They might just fade or get dog-eared, but won't become completely unusable, * It's a more expensive outlay and uses scarce physical space, so you'll think more carefully about what to archive and therefore have a higher quality archive that you (and subsequent generations) are more likely to access. The downside I guess is backups are far more difficult, but not impossible, and they will be slightly worse quality than the master copy. But if you lose a master copy of something, would it really be the end of the world? Sometimes we lose things. That's life.
- mharig 2y ago[dead]
- LIzzyytujghf 2y ago[dead]