9 ms·
Backblaze Hard Drive Stats for 2017
- opendomain 9y agoI love these posts - so much that when my laptop died for a few days, I immediately signed up for Backblaze backup when it came back to life.
- atYevP 9y agoGlad we could help!
- bobbles 9y agoWithin the last month I had to do a full 2TB recovery using 50GB to 150GB recovery files.. truly a life saver! I was able to completely start from scratch with a clean widnows install and a new HDD after one day my computer just straight up died (zero HDD activity at all). So.. thanks!
- omnifischer 9y agohow much time it took to download 2 TB
- gizmo686 9y agoBlackblaze supports FedexNet. Latency is atrosious, but its bandwidth is hard to beat.
- blacksmith_tb 9y agoAside from happily using Backblaze, their stats have convinced me to go with HGST for spinning rust several times now.
- balladeer 9y agoSince atYevP often comments on these posts here on HN, I thought I will use this opportunity to ask few questions about two of their products. And I am also asking because such questions usually get sidestepped elsewhere or maybe it just seems so :-) Hi Yev, 1. Months ago when CrashPlan shut its doors to individual customers you (and a founder) had mentioned you guys are planning on (possibly) changing the data deletion and version/data retention policy of BackBlaze to something less outrageous. Any update on that? 2. Also, there have been mentions of letting users use the BackBlaze backup app (or some other app by BackBlaze) where they can set the destination/sink to a B2 account, set rules regarding what to backup, frequency, retention, pruning etc. Users will pay for what they use - essentially fixing many of the "point 1" complaints (mentioned above). Any updates on this either? (And no other integrated apps so far just don't cut it) 3. Adding a proper restore interface to the standard backup app - with proper pause and resume of course, and with option of saving to a location specified by the user (you can actually just copy CrashPlan on this :P); and not just limiting users to the browser restore interface or shipping the hard disk. Past threads: https://news.ycombinator.com/item?id=15125340 https://news.ycombinator.com/item?id=15125340 https://news.ycombinator.com/item?id=15072866 https://news.ycombinator.com/item?id=15072866
- chx 9y agoWhile you might have some legit grief with the service Backblaze provides, I would recommend toning the accusatory tone down by several notches. "questions sidestepped" "outrageous" etc. This is a courteous place.
- ryanlol 9y agoPerhaps it would also be courteous to read balladeers comment more charitably, it hardly seems right to describe it as "accusatory" or to accuse him of presenting loaded questions. He asked some perfectly reasonable questions for which he presumably was unable to get answers elsewhere, hence "sidestepped". Pointing out that he finds a policy "outrageous" is hardly rude.
- balladeer 9y agoSorry about my choice of words if you, or others, found it inflammatory or uncouth. Maybe I got carried away while writing genuine queries in a casual manner is all.
- kqr 9y agoNeat! One of the RAID mirror drives at home is showing some pre-failure signs, so I'm looking to insert a hot spare. I guess HGST or Toshiba is the way to go!
- frumiousirc 9y agoNot necessarily. One nice thing about this report is they take into account the low statistics in some of their drive models and represent that as confidence intervals. If you look at the second table, 8TB HGST and 5TB Toshiba have a wide uncertainty due to them having tested fewer of these drives so far. Their data can not yet tell us if the AFR for these drives are significantly different from others. They do have many of the smaller 4TB HGST and so have tight uncertainty on them and they are indeed low AFR. So if that size is suitable then it's a no brainer choice. But, if bigger capacities are needed and looking at the high confidence limit column, the 6TB and 8TB Seagate models are safer bets.
- JepZ 9y agoDoes anybody know why they still use so many Seagate and WD models when the HGST seem to have the better reliability? Am I reading the stats wrong or are other factors involved like higher prices or so?
- deleted 9y ago[deleted]
- boomboomsubban 9y agoThey aren't using many WD drives at all, and in the high use drives HSGT's roughly 1% failure rate against Seagate's roughly 2% failure rate is offset by price.
- hvidgaard 9y agoIf the TCO / TB is lower, then it doesn't matter if they fail more often, it's already factored in.
- dspillett 9y agoAs well as the risk/cost calculation already mentioned, it makes sense to spread over multiple manufacturers to allow for sudden problems with the one that is currently most reliable. If HGST has a huge production problem now that doesn't make its effects known until silly high rates of failure occur a year down the line, backblaze and other large storage providers would have a sudden glut of replacements to manage (possibly pro-active replacements, or even worse the expense of bulking up their redundancy level at least temporarily to mitigate the extra risk). Spreading over multiple manufacturers limits the impact of situations like this.
- w0m 9y agoThis. The differences in failure rate aren't worth the risk.
- AdamJacobMuller 9y agoIt's also very beneficial to spread data across different drive manufacturers. If, for example, a particular HGST model starts to have massive failure problems in a year (massive at this scale would be like 20% failure rates), well, at least you still have a healthy population of Seagate/WD drives where the data on the HGST drives is also replicated to. I wouldn't be remotely shocked if the Backblaze software takes drive model into account in data placement. In addition to that, it makes sense from a purchasing perspective to spread your purchases around to many vendors. Make sure that Hitachi knows that they're not irreplaceable if they don't give you a good enough price you'll just buy more Seagate drives. Make Seagate always be worried that if you shifted enough purchasing to HGST they'll cut you a really good deal and potentially undercut Seagate.
- deleted 9y ago[deleted]
- red0point 9y agoAs I was dissatisfied by their provided graphs, I made up my own using R & Kaplan Meier Survival tools to determine how long I could expect a hard drive to „survive“. https://medium.com/@simonerni/dissecting-backblaze-hard-drive-stats-2017-17a90089a2e8 https://medium.com/@simonerni/dissecting-backblaze-hard-driv...
- Already__Taken 9y agoI know they don't use SSD due to cost and it's probably excessive performance for their needs. But I wonder how their costs compare when you factor in the density and energy efficiencies. You could fit a lot of silicon in the space a storage post has for 45 3.5" drives. I found their 2014 blog post about a 500PB new datacenter, and their recent 2018 post is about crossing 500PB. So does storage per sqr/foot ever matter or is it just better to get another DC?
- pjc50 9y agoSSD is not a great long-term archival medium as it's not passively stable in the way that magnetised media is, and it's still much more expensive.
- chx 9y agoA spinning disk dissipates about 6W on average, for 100 000 disks that's 600kw. With an average of 0.12 USD paid for a kwh times 24 hours, their energy bill is less than 2000 USD a day. Their HDD cost based on the "81.76 — The number of hard drives that were installed each day in 2017." and we know they mostly now do 8TB at roughly 0.02 USD per GB according to https://www.backblaze.com/blog/hard-drive-cost-per-gigabyte/ https://www.backblaze.com/blog/hard-drive-cost-per-gigabyte/ which is 13000 USD a day. That means even if we had SSDs at zero watts, they would need to be (13+2/13) ~ 15% more expensive than HDDs in order to break even but if you look at https://pcpartpicker.com/trends/price/internal-hard-drive/ https://pcpartpicker.com/trends/price/internal-hard-drive/ you will see it's still about 8 times as expensive. Obviously there's some savings due to floor space but the savings are going to be really low there. And this is just the economics side.
- AdamJacobMuller 9y agoIn addition to the other points, there are other issues besides just cramming a raw number of bytes into a raw amount of space. You need to balance disk space with IO capacity with compute with memory. Simply replacing all of the 3.5" drives with an equivalent volume of SSDs probably leaves you well under-balanced on the memory/compute side and way overbalanced on the IO side. In addition, you need to develop hardware to interface with way more drives per chassis (massive-scale expanders). There'd be a lot of engineering costs associated with getting that much denser in terms of the number of drives per U (figure 6 or 8 times as many per U). Of course, this could pay off if there was a cost benefit to denser servers, but, datacenter space at their scale is primarily priced at a function of how much (and what quality) power you need. Being denser isn't ultimately going save them much if any money.
- FraKtus 9y agoSeems to be down... I suppose we are all jumping on it to see what to buy next :-)
- atYevP 9y agoYev from Backblaze -> Heh, clear cache and try again?
- agumonkey 9y agoThere a webinar link at the bottom, might be interesting https://www.brighttalk.com/webcast/14807/300531?utm_source=Backblaze-blog&utm_medium=brighttalk&utm_campaign=300531 https://www.brighttalk.com/webcast/14807/300531?utm_source=B... in case people didn't see