14 ms·
I store on an external HD, and every year I buy a new HD and copy across to it and verify checksums against my records. Costs basically zero and low-effort. Wha
by chrisseaton 6y ago
I store on an external HD, and every year I buy a new HD and copy across to it and verify checksums against my records. Costs basically zero and low-effort. What am I missing?
- sgt 6y agoEvery year you buy a new HD and yet the cost is basically zero?
- chrisseaton 6y agoYeah what does a new HD cost? Like £100 max for a big high quality one? Compared to buying a £5k tape drive and expensive tapes... yeah that's basically zero.
- jjulius 6y ago$100 is definitely not "basically zero". Not only that, but a $5k tape drive and tapes are designed to last a significantly longer period of time, essentially bringing the cost of long-term storage closer to $0/year than your option of spending $100/year.
- aidenn0 6y agoIt's 50 years before $100/year catches up with a one-time cost of $5k. On top of that, the total capacity of the mediumgoes up steadily over time, while you will need to drop another $5k every 10 years or so or span your backups across multiple tapes.
- sgt 6y agoIn reality I am sure he could get away with buying a new drive every 5 years.
- stratosgear 6y ago5k amortized at 100/year is 50 years to get your money's worth. It seems 100/year is a much better deal. I don't see your math working out...
- webmobdev 6y agoThat's assuming a consumer tape drive will cost that much. They'll succeed only if they cost less than $500. Enterprisey stuffs are always costly. Just like consumer grade HDDs vs entrprise HDDs.
- chrisseaton 6y ago> a $5k tape drive and tapes are designed to last a significantly longer period of time You're going to use the drive for 50 years? 50 years? Half a century? And you think it'll be working and supporting a format with a useful capacity in half a century?
- webmobdev 6y agoYou miss the point - consumer tape drives won't cost 5k, just like consumer HDD's are cheaper than enterprise HDD's.
- sgt 6y agoAbout consumer tape drive reliability though...
- centimeter 6y agoWhy do you do this manual checksumming thing instead of e.g. setting up a ZFS mirror once every n years?
- chrisseaton 6y agoBecause simple and manually inspectable is better for backups.
- centimeter 6y agoWhat do you do if you find a checksum error? ZFS mirror will fix it for you.
- chrisseaton 6y agoWhat do you think I do? Copy from the last good copy.
- dragontamer 6y agoZFS does that, except with error correction codes applied against bitrot. All you gotta do is turn on a ZFS-system and hit the "scrub" command. That automatically checks all checksums: and error-corrects all data that fails a checksum. If anything, ZFS makes that whole system you just described easier and more automatic. Its not really hard for me to push the "scrub" button on my Nas4Free box every few months.
- pishpash 6y agoWhat do you do with errors within the latest increment? A shelf of annual HDD's doesn't sound too bad otherwise.
- jjulius 6y ago>... every year I buy a new HD... OK, but OP said: >It's really a pain to keep transferring your old backups every 2-5 years...
- chrisseaton 6y agoBecause they're considering options like DVDs. With a new HD you can just copy it across in one step.
- jjulius 6y agoOP explicitly mentioned HDDs in their post; they do not want to be transferring data to a new HDD every year, or two years, or five years.
- chrisseaton 6y agoWell that's why I asked what I'm missing! It's just one command to copy from an old HD to the new HD? Takes me all of 30 mins once a year.
- webmobdev 6y agoYou have to save your important data in multiple mediums to keep it safe. This is in case one medium fails. Obviously, cost being a factor, optical disks is one of the mediums to be considered despite all its other downsides (slow transfer speed).
- tomcam 6y agoNot trying to be rude or sarcastic here: what is that command? Certainly in my experience on both macOS and windows, the default operating system GUI mass copy invariably poops out halfway through, with no explanation as to why. Maybe something like this? rsync --archive --acls --xattrs --checksum --vvv /src /dest
- pizza234 6y agoThe OP is mixing mediums with different characteristics. The DVD has a fixed size (say, 5.x GB), while hard disks are relatively open-ended. One can buy 10+ TB magnetic disks for a cheap price (less than 200$). If the OP really needs dozens of TBs of capacity every few year, they definitely don't fit in the home user market they are talking about.
- weare138 6y agoLow cost, high density and a low failure rate compared to HDs. That's why it's still used in the enterprise for backup solutions.
- chrisseaton 6y agoI don't think these are home-use concerns.
- martyvis 6y agoActually nearly every enterprise backup system my company has deployed in the last 5 years is tapeless. Most systems involve snapshot backup management that are replicated across multiple disc/SSD systems. (I'm the network guy, so not my focus area)
- KingMachiavelli 6y agoTape is moving from just 'enterprise' to cloud provider enterprise. The periodic cost of having a tape storage/management system installed is a hard pill to swallow. Most companies still use tape but they just access it via AWS Glacier.
- Tokkemon 6y agoNormal people don't know what a checksum is.... or they think that's the amount their paid every week from the bank.
- chrisseaton 6y agoThe checksum isn't the relevant bit. That doesn't change whether you use a hard drive, a tape, or a DVD. Forget about it as part of the discussion if you want.
- webmobdev 6y ago> What am I missing? Money - The cost factor of buying the new HDD. And to be safe, you need to have more than one medium. That's again more cost. Time - Ensuring that your existing machine is compatible with both your old and new disks (IDE vs SATA or working DVD drives for example).