5 ms·

"Most people need their data a lot less than they think they do" - great way to put it and a thought provoking article.

santoshalper 5y ago
Especially in a world where so much data now "lives" in the cloud. Between my dropbox, github, google photos, etc. Very little of my data only lives on a hard drive. The stuff that does lives on a Synology NAS and is mirrored to S3 Glacier weekly.
- sreeramb93 5y ago
  NAS mirrored to S3 Glacier. How much does it cost?
  - xyzzy_plugh 5y ago
    In my experience this is very cheap. I take it the parent is not retrieving from Glacier often/ever, which is where the significant costs go. It's a decent balance for disaster recovery. I sync my photos to S3 (a mix of raw and jpeg, sidecar rawtherapee files) across a few devices so Glacier is prohibitively expensive in this regard, but I still pay <$100 a year for more stuff than I could ever store locally.
    - kstrauser 5y ago
      I did the math, and for me Glacier is great for backups where homeowners insurance is likely to be involved in the restoral. It was ferociously expensive for anything less drastic.
      - laurentb 5y ago
        how would that process look like in practice should you need to get to call the insurance guys? as in, would you claim on the cost to retrieve the data or ? (this question is general, regardless of the actual country)
        kstrauser 5y ago
        I honestly don't know. I've never had to use it.
      - DougWebb 5y ago
        I'm trying to figure out the costs. To back up my NAS at full capacity, I need 10TB of storage. Using S3 Glacier Deep Archive, that seems to cost $10/month per full backup image I keep. That's not bad. What's confusing is that the calculator has "Restore Requests" as the # of requests, "Data Retrievals" as TB/month, but there's also a "Data Transfer" section for the S3 calculator. If I add 1 restore request for 10TB of data (eg: restoring my full backup to the NAS), that adds about $26 for that month. Totally reasonable. However, if "Data Transfer" is relevant, and I can't tell if it is or isn't, uploading my backup data is free but retrieving 10TB would cost $922! Is that right? This is what has always deterred me from using AWS. It's so unclear what services and fees will apply to any given use case, and it seems like there's no way to know until Amazon decides that you've incurred them. At $10/month for storage and $26 if I need to restore, I can just set this up and I don't need to plan for disaster recovery expenses. But if it's going to cost me $922 to get my data back, I've got to figure out how to make sure my insurance is going to cover that. This isn't a no-brainer anymore. Also, what assurance do I have that the cost isn't going to be higher when I need the data, or that there won't be other fees tacked on that I've missed? [1] https://calculator.aws/#/createCalculator/S3 https://calculator.aws/#/createCalculator/S3
        seized 5y ago
        Glacier pricing can be hard to grok... With Glacier as it is usually used you dont read data directly from the Glacier storage, it has to be restored to S3 where you then access it. That is the restore charges and the delays, so you can pay a low rate for the bulk option that takes up to 24 hours to restore your data to S3. But the real cost is the bandwidth from S3 back to your NAS/datacenter/etc, which brings it up to about $90USD/TB. Other fees would include request pricing, some low amount per 1000 requests. So costs can go up a bit if you store 1 million small files to Glacier vs 1000 large files. There is also a tipping point (IIRC about 170KB) where it is cheaper to store small files on S3 than Glacier. Depending on your data and patterns it can be better to use Glacier as a second backup which is what I do. All my data is backed up to a Google Workspace as that is "unlimited" for now. The most important subset (a few TB) also goes to Glacier. Glacier is pay as you go, there isnt some "unlimited" or "5TB for life" type deal that can change. If Google Workspace ever becomes not "unlimited" or something happens to it, I have the most important data in Glacier and its data that I have no qualms paying >$1k to get back. But for me restoring from Glacier means that my NAS is dead (ZFS RAIDZ2 on good hardware) and Google Workspace has failed me at the same time.
  - santoshalper 5y ago
    Few bucks a month. More if I needed to retrieve something.
  - unethical_ban 5y ago
    I don't have automated mirroring set up, but I have insight. I use a Windows free tool called FastGlacier. I set up an IAM user on my AWS account for my backups, and use those creds to login. Then it's drag and drop! You can even use FastGlacier to encrypt/decrypt on the fly as you upload and download. Glacier is cheap because the retrieval times are very slow - something like 1-12 hours depending on the tier. I have about 100GB of critical data. Personal documents, photos and some music I don't want to have to search for if the house burns down. It's something like a dollar a month. Less than a cup of coffee.
    - thrtythreeforty 5y ago
      Deep Archive is super cost effective, $1/TB/mo. For the house-burns-down scenario, I don't mind the 24hr retrieval time
  - seized 5y ago
    Glacier is about $1USD/TB/month just for storing data. If you need to retrieve it ends up being about $90USD/TB, most of that is bandwidth charges.
    - adrian_b 5y ago
      That means that if you store the data for much more than a half of year, Glacier becomes more expensive than storing on tapes. Of course, tapes require a tape drive and its cost would require a lot of data to compensate the cost, but at a such high cost of retrieval it would not take much data to equal the cost of a tape drive. Glacier is OK for a couple of TB, but for tens or hundreds it would not be suitable.
      - Dylan16807 5y ago
        > Of course, tapes require a tape drive and its cost would require a lot of data to compensate the cost, but at a such high cost of retrieval it would not take much data to equal the cost of a tape drive. But the less you expect to use it, the less this matters. So I'd put the break-even point a bit higher. Tape is good for 100TB or more but for tens it's hard to justify a tape drive. Also it's important to remember to get those tapes offsite every week!
- wazoox 5y ago
  But Dropbox, Github, Google photos etc rely on massive piles of hard drives.
  - santoshalper 5y ago
    Sure, but the comment was about personal storage. Fault tolerance at the edge is less important in a cloud world.
behringer 5y ago
I can't imagine wasting NVME storage on backup data. That's what I have my 8tb spinning hdds for.
- Koshkin 5y ago
  Isn't tape more cost-effective and reliable? (Also, your backups do not need to be spinning all the time, if that's what they are doing.)
  - whatshisface 5y ago
    Right now disks are cheaper than tapes, even if you don't count the very expensive tape readers.
    - eqvinox 5y ago
      This is incorrect. I recently acquired an LTO-6 tape library; the tapes are <20€ for 2.5TB true capacity (marketing = "6TB compressed".) That's <8€/TB. Disk drives start at 20€/TB for the cheapest garbage. Sources: https://geizhals.eu/?cat=zip&xf=1204_LTO-6 https://geizhals.eu/?cat=zip&xf=1204_LTO-6 (tapes) https://geizhals.eu/?cat=hde7s&sort=r https://geizhals.eu/?cat=hde7s&sort=r (disks) (For completeness, the tape library ran me 500€ on eBay used, but they normally run about twice that. It's a 16-slot library, which coincidentally matches the breakeven - filled for 40TB it's 820€, the same in disks would've been 800€, though I would never buy the cheapest crappy disks.) FWIW, a major reason for going for tapes for me was that at some point my backup HDDs always ended up used for "real". The tape library frees me from trying to discipline myself to properly separate backup HDDs ;)
      - adrian_b 5y ago
        For newer tape formats the prices are similar or even a little lower. For example, at Amazon in Europe an LTO-7 cartridge is EUR 48 for 6 real TB (EUR 8 per real TB), while an LTO-8 cartridge is EUR 84 for 12 real TB (EUR 7 per real TB). At Amazon USA I see now $48 for LTO-7 and $96 for LTO-8, i.e. $8 per TB if you buy 1 tape. For larger quantities, there are discounts. Older formats like LTO-6 have the advantage that you may find much cheaper tape drives, but you must handle more cartridges for a given data size. Currently the cheapest HDDs are the external USB drives with 5400 rpm, which are much slower, about 3 times slower than the tapes, but even those are many times more expensive than the tapes (e.g. $27 ... $30 per TB).
zwieback 5y ago
Yes, interesting thought. On my ride in to work I was actually thinking how our situation is exactly opposite: in our environment (R&D test and measurement and production automation) data is everything and never in the cloud so we don't get to benefit from all the cool stuff the kids are doing these days. Historical data can go in the cloud (as long as we're reasonably sure it's secure) but operational data from our test and production tooling (e.g. assembly lines and end-of-line audit tools) has to be right there with super short latency. So we're still very interested in things like hard disks, NVMe, etc.
birdyrooster 5y ago
I know for a fact I don’t need 40T of movies and tv, but that changes nothing
- dannyw 5y ago
  Pfft. 440tb of data hoarding on my NAS. ;)
rattray 5y ago
Yep, reminds me of a tech blog I read in the last year or so (can't remember where) that talked about using 6 replicas for each DB shard (across 3 AZ's IIRC)… they just used EC2's on-disk NVMe storage (which is "ephemeral") because it's faster and hey, if the machine dies, you have replicas! This post's point that even with that setup, it's still nice to have volume-based storage for quicker image replacements is interesting, I'm not experienced enough with cloud setups to know if that makes sense (eg how long does it take to upgrade an EC2 instance that has data on disk? upgrade your OS? upgrade your pg version? does ephemeral storage vs volume storage affect these? I imagine not…)
NikolaNovak 5y ago
I think it's often true at business level (most departments in a large company don't need redundancy and uptime they think they do), and rarely if ever true at personal/family level (most people don't think their phone/tablet/laptop could lose their data; most people don't think of their data past photos they took this week - "Oh it's OK to lose... wait, my tax documents are gone? Photos of my baby from two years ago are gone? My poems are gone? My [.. etc] is gone???"?).

Especially in a world where so much data now "lives" in the cloud. Between my dropbox, github, google photos, etc. Very little of my data only lives on a hard drive. The stuff that does lives on a Synology NAS and is mirrored to S3 Glacier weekly.

sreeramb93 5y ago
NAS mirrored to S3 Glacier. How much does it cost?
- xyzzy_plugh 5y ago
  In my experience this is very cheap. I take it the parent is not retrieving from Glacier often/ever, which is where the significant costs go. It's a decent balance for disaster recovery. I sync my photos to S3 (a mix of raw and jpeg, sidecar rawtherapee files) across a few devices so Glacier is prohibitively expensive in this regard, but I still pay <$100 a year for more stuff than I could ever store locally.
  - kstrauser 5y ago
    I did the math, and for me Glacier is great for backups where homeowners insurance is likely to be involved in the restoral. It was ferociously expensive for anything less drastic.
    - laurentb 5y ago
      how would that process look like in practice should you need to get to call the insurance guys? as in, would you claim on the cost to retrieve the data or ? (this question is general, regardless of the actual country)
      - kstrauser 5y ago
        I honestly don't know. I've never had to use it.
    - DougWebb 5y ago
      I'm trying to figure out the costs. To back up my NAS at full capacity, I need 10TB of storage. Using S3 Glacier Deep Archive, that seems to cost $10/month per full backup image I keep. That's not bad. What's confusing is that the calculator has "Restore Requests" as the # of requests, "Data Retrievals" as TB/month, but there's also a "Data Transfer" section for the S3 calculator. If I add 1 restore request for 10TB of data (eg: restoring my full backup to the NAS), that adds about $26 for that month. Totally reasonable. However, if "Data Transfer" is relevant, and I can't tell if it is or isn't, uploading my backup data is free but retrieving 10TB would cost $922! Is that right? This is what has always deterred me from using AWS. It's so unclear what services and fees will apply to any given use case, and it seems like there's no way to know until Amazon decides that you've incurred them. At $10/month for storage and $26 if I need to restore, I can just set this up and I don't need to plan for disaster recovery expenses. But if it's going to cost me $922 to get my data back, I've got to figure out how to make sure my insurance is going to cover that. This isn't a no-brainer anymore. Also, what assurance do I have that the cost isn't going to be higher when I need the data, or that there won't be other fees tacked on that I've missed? [1] https://calculator.aws/#/createCalculator/S3 https://calculator.aws/#/createCalculator/S3
      - seized 5y ago
        Glacier pricing can be hard to grok... With Glacier as it is usually used you dont read data directly from the Glacier storage, it has to be restored to S3 where you then access it. That is the restore charges and the delays, so you can pay a low rate for the bulk option that takes up to 24 hours to restore your data to S3. But the real cost is the bandwidth from S3 back to your NAS/datacenter/etc, which brings it up to about $90USD/TB. Other fees would include request pricing, some low amount per 1000 requests. So costs can go up a bit if you store 1 million small files to Glacier vs 1000 large files. There is also a tipping point (IIRC about 170KB) where it is cheaper to store small files on S3 than Glacier. Depending on your data and patterns it can be better to use Glacier as a second backup which is what I do. All my data is backed up to a Google Workspace as that is "unlimited" for now. The most important subset (a few TB) also goes to Glacier. Glacier is pay as you go, there isnt some "unlimited" or "5TB for life" type deal that can change. If Google Workspace ever becomes not "unlimited" or something happens to it, I have the most important data in Glacier and its data that I have no qualms paying >$1k to get back. But for me restoring from Glacier means that my NAS is dead (ZFS RAIDZ2 on good hardware) and Google Workspace has failed me at the same time.
- santoshalper 5y ago
  Few bucks a month. More if I needed to retrieve something.
- unethical_ban 5y ago
  I don't have automated mirroring set up, but I have insight. I use a Windows free tool called FastGlacier. I set up an IAM user on my AWS account for my backups, and use those creds to login. Then it's drag and drop! You can even use FastGlacier to encrypt/decrypt on the fly as you upload and download. Glacier is cheap because the retrieval times are very slow - something like 1-12 hours depending on the tier. I have about 100GB of critical data. Personal documents, photos and some music I don't want to have to search for if the house burns down. It's something like a dollar a month. Less than a cup of coffee.
  - thrtythreeforty 5y ago
    Deep Archive is super cost effective, $1/TB/mo. For the house-burns-down scenario, I don't mind the 24hr retrieval time
- seized 5y ago
  Glacier is about $1USD/TB/month just for storing data. If you need to retrieve it ends up being about $90USD/TB, most of that is bandwidth charges.
  - adrian_b 5y ago
    That means that if you store the data for much more than a half of year, Glacier becomes more expensive than storing on tapes. Of course, tapes require a tape drive and its cost would require a lot of data to compensate the cost, but at a such high cost of retrieval it would not take much data to equal the cost of a tape drive. Glacier is OK for a couple of TB, but for tens or hundreds it would not be suitable.
    - Dylan16807 5y ago
      > Of course, tapes require a tape drive and its cost would require a lot of data to compensate the cost, but at a such high cost of retrieval it would not take much data to equal the cost of a tape drive. But the less you expect to use it, the less this matters. So I'd put the break-even point a bit higher. Tape is good for 100TB or more but for tens it's hard to justify a tape drive. Also it's important to remember to get those tapes offsite every week!
wazoox 5y ago
But Dropbox, Github, Google photos etc rely on massive piles of hard drives.
- santoshalper 5y ago
  Sure, but the comment was about personal storage. Fault tolerance at the edge is less important in a cloud world.

behringer 5y ago

I can't imagine wasting NVME storage on backup data. That's what I have my 8tb spinning hdds for.

Koshkin 5y ago
Isn't tape more cost-effective and reliable? (Also, your backups do not need to be spinning all the time, if that's what they are doing.)
- whatshisface 5y ago
  Right now disks are cheaper than tapes, even if you don't count the very expensive tape readers.
  - eqvinox 5y ago
    This is incorrect. I recently acquired an LTO-6 tape library; the tapes are <20€ for 2.5TB true capacity (marketing = "6TB compressed".) That's <8€/TB. Disk drives start at 20€/TB for the cheapest garbage. Sources: https://geizhals.eu/?cat=zip&xf=1204_LTO-6 https://geizhals.eu/?cat=zip&xf=1204_LTO-6 (tapes) https://geizhals.eu/?cat=hde7s&sort=r https://geizhals.eu/?cat=hde7s&sort=r (disks) (For completeness, the tape library ran me 500€ on eBay used, but they normally run about twice that. It's a 16-slot library, which coincidentally matches the breakeven - filled for 40TB it's 820€, the same in disks would've been 800€, though I would never buy the cheapest crappy disks.) FWIW, a major reason for going for tapes for me was that at some point my backup HDDs always ended up used for "real". The tape library frees me from trying to discipline myself to properly separate backup HDDs ;)
    - adrian_b 5y ago
      For newer tape formats the prices are similar or even a little lower. For example, at Amazon in Europe an LTO-7 cartridge is EUR 48 for 6 real TB (EUR 8 per real TB), while an LTO-8 cartridge is EUR 84 for 12 real TB (EUR 7 per real TB). At Amazon USA I see now $48 for LTO-7 and $96 for LTO-8, i.e. $8 per TB if you buy 1 tape. For larger quantities, there are discounts. Older formats like LTO-6 have the advantage that you may find much cheaper tape drives, but you must handle more cartridges for a given data size. Currently the cheapest HDDs are the external USB drives with 5400 rpm, which are much slower, about 3 times slower than the tapes, but even those are many times more expensive than the tapes (e.g. $27 ... $30 per TB).

zwieback 5y ago

Yes, interesting thought. On my ride in to work I was actually thinking how our situation is exactly opposite: in our environment (R&D test and measurement and production automation) data is everything and never in the cloud so we don't get to benefit from all the cool stuff the kids are doing these days. Historical data can go in the cloud (as long as we're reasonably sure it's secure) but operational data from our test and production tooling (e.g. assembly lines and end-of-line audit tools) has to be right there with super short latency. So we're still very interested in things like hard disks, NVMe, etc.

birdyrooster 5y ago

I know for a fact I don’t need 40T of movies and tv, but that changes nothing

dannyw 5y ago
Pfft. 440tb of data hoarding on my NAS. ;)

rattray 5y ago

Yep, reminds me of a tech blog I read in the last year or so (can't remember where) that talked about using 6 replicas for each DB shard (across 3 AZ's IIRC)… they just used EC2's on-disk NVMe storage (which is "ephemeral") because it's faster and hey, if the machine dies, you have replicas! This post's point that even with that setup, it's still nice to have volume-based storage for quicker image replacements is interesting, I'm not experienced enough with cloud setups to know if that makes sense (eg how long does it take to upgrade an EC2 instance that has data on disk? upgrade your OS? upgrade your pg version? does ephemeral storage vs volume storage affect these? I imagine not…)

NikolaNovak 5y ago

I think it's often true at business level (most departments in a large company don't need redundancy and uptime they think they do), and rarely if ever true at personal/family level (most people don't think their phone/tablet/laptop could lose their data; most people don't think of their data past photos they took this week - "Oh it's OK to lose... wait, my tax documents are gone? Photos of my baby from two years ago are gone? My poems are gone? My [.. etc] is gone???"?).