4 ms·
> two SSDs with high reliability ratings fail for us sequentially in a RAID array in a server, Happens all the time when you buy storage in batches. We learned
by WrtCdEvrydy 4y ago
> two SSDs with high reliability ratings fail for us sequentially in a RAID array in a server,
Happens all the time when you buy storage in batches. We learned a lesson, go through 3-4 suppliers and split your orders over a three month period. Buying from one place in bulk is just guaranteeing data loss in your future.
- baruch 4y agoI know that this idea nugget comes up time and time again when discussing drives, but I'm working on large storage systems for over 10 years now and dealing with the drives and their reliability and have yet to see such an occurrence. I've dealt with deployed systems that had (in many different clusters) a total of upwards of 100K HDDs and also with 10K SSDs and for extended periods. I saw tons of drive failures of many types but never even once did I see two or more drives of the same batch fail soon one after the other.
- WrtCdEvrydy 4y agoIt's not so much batch these days as conditions. Individual sellers probably use the same shipping method for every order and they may order in large batches which are transported at the same time. Although SSDs are a bit more resilient, hard temperature spikes in a single batch won't be detected after shipping. In the past, we would do this for hard drives because although parked heads are safe, high G-loads could actually unpark a head.
- icelancer 4y agoYeah I found this out post-incident from the Backblaze blog, which I read pretty religiously but this particular nugget of info escaped me.