4 ms·

RAID drive fails, "I regretted installing ClamAV". Don't regret it! It allowed you to find a drive failure before a second drive failed, and allowed you to re

RAID drive fails, "I regretted installing ClamAV". Don't regret it! It allowed you to find a drive failure before a second drive failed, and allowed you to recover your data while it was still recoverable! This is a good thing! Archival data is a tricky problem. If you don't regularly read it, you may find that when you do need to read it, that the sector has suffered some bit rot. What's one of the most likely cases where you have to read archived data? When a hard drive fails and RAID is doing a rebuild... So, by all means, run a ClamAV scan! Or better yet, run a ZFS scrub monthly or so. I've been a huge fan of ZFS for my archive data, mostly historic photos and Google takeout data now, because it can detect silent corruption and can do scrubs to verify and repair any hard drives sectors that have problems.

humaid 6y ago
Thank you for the advice. Will keep it mind when setting it up with the new drives!
- linsomniac 6y ago
  Oh, my other advice is: Avoid Seagate drives. Historically, I've found Hitachi to be the most reliable, and the BackBlaze hard drive stats seem to confirm that, though they tend to have small numbers of Hitachi drives. This is because they optimize for price not reliability. I've had good luck with other brands, but I've pretty much had universally bad luck with Seagate. Last year I replaced the last of our Stagate 15K drives with SSDs because, largely, I was tired of doing warranty returns every month or two.
  - zepearl 6y ago
    I used to always buy Hitachi as well, but when I decided a few weeks ago to replace all my old 4TB HDDs with 8TB HDDs I found out that they're quite expensive (did they use to be that expensive?). Well, in any case now I bought 8 Toshiba N300 8TB (4 HDDs for a server and another 4 for a NAS, both used by a RaidZ1) and so far they worked (and they're not loud and don't vibrate like hell when the disk is spinning, unlike the WD Gold). It's the first time that I buy Toshiba HDDs - I'm quite sure that if they would have been Seagate then at least 1 would have already failed.
    - linsomniac 6y ago
      Hitachi have always been a little more expensive than the others, from my memory. The Deskstar consumer line could be around 10-20% more than competition and the Ultrastar enterprise 25-50% more than Deskstar. Going from memory. I've had good luck with the few Toshiba drives I've had. That's what my storage system is running right now because it was the only thing I could find in 1TB laptop form factor when I bought them 6-7 years ago.
    - ValentineC 6y ago
      Not to second-guess your purchase, but was there a reason you didn't diversify across the brands to prevent a situation where they might all fail at once?
      - linsomniac 6y ago
        I'm reminded of those HP drives that would brick themselves after a certain number of operating hours. People had every drive in their RAID array fail at once.
        zepearl 6y ago
        Ooook, ok, I got it - not a great idea to buy HDDs of the same brand => I'll try to remember this :) But: in such a case, having a normal raid5/raidZ1 or even a raid6/raidZ2, etc..., you might still get scrd by just having 2/3/4 such HP-drives in such a raid (that might be composed of 8/9/10 drives), right?
        ValentineC 6y ago
        > you might still get scrd by just having 2/3/4 such HP-drives in such a raid (that might be composed of 8/9/10 drives), right? That's true. Ah well, you know what people say: RAID is for high-availability, not a replacement for proper backups.
        zepearl 6y ago
  - comboy 6y ago
    > have small numbers of Hitachi drives 25,000+ drives according to 2020 Q1 report in case anyone is wondering
  - jlgaddis 6y ago
    > Oh, my other advice is: Avoid Seagate drives ... I've found Hitachi to be the most reliable ... but I've pretty much had universally bad luck with Seagate. Don't take this personally but this advice is fairly useless. For every person like you, who has "found Hitachi to be the most reliable" and "had universally bad luck with Seagate", there's someone else who has the exact opposite advice. Our opinions are shaped by our own experiences, of course, and (most of the tine) it's hard to change our minds or convince us otherwise. The (unfortunate) truth is that there's no one brand of HDDs that really is "the best" -- especially for all use cases! If there were, well, we'd all be using them by now and all of the other manufacturers would have already went out of business.
    - pfranz 6y ago
      Also, the bummer about the Backblaze stats is that they can't tell you about new batches of drives.
    - linsomniac 6y ago
      I would generally agree with you, but it comes from a decently sized sample set (not huge, a few thousand), but also because it seems to be backed up consistently by Backblaze's stats. :-)
cure 6y ago
But if you ZFS, avoid the crappy WD red SMR drives! Cf. https://www.servethehome.com/wd-red-dm-smr-update-3-vendors-bail-and-wd-knew-of-zfs-issues/ https://www.servethehome.com/wd-red-dm-smr-update-3-vendors-...

humaid 6y ago

Thank you for the advice. Will keep it mind when setting it up with the new drives!

linsomniac 6y ago
Oh, my other advice is: Avoid Seagate drives. Historically, I've found Hitachi to be the most reliable, and the BackBlaze hard drive stats seem to confirm that, though they tend to have small numbers of Hitachi drives. This is because they optimize for price not reliability. I've had good luck with other brands, but I've pretty much had universally bad luck with Seagate. Last year I replaced the last of our Stagate 15K drives with SSDs because, largely, I was tired of doing warranty returns every month or two.
- zepearl 6y ago
  I used to always buy Hitachi as well, but when I decided a few weeks ago to replace all my old 4TB HDDs with 8TB HDDs I found out that they're quite expensive (did they use to be that expensive?). Well, in any case now I bought 8 Toshiba N300 8TB (4 HDDs for a server and another 4 for a NAS, both used by a RaidZ1) and so far they worked (and they're not loud and don't vibrate like hell when the disk is spinning, unlike the WD Gold). It's the first time that I buy Toshiba HDDs - I'm quite sure that if they would have been Seagate then at least 1 would have already failed.
  - linsomniac 6y ago
    Hitachi have always been a little more expensive than the others, from my memory. The Deskstar consumer line could be around 10-20% more than competition and the Ultrastar enterprise 25-50% more than Deskstar. Going from memory. I've had good luck with the few Toshiba drives I've had. That's what my storage system is running right now because it was the only thing I could find in 1TB laptop form factor when I bought them 6-7 years ago.
  - ValentineC 6y ago
    Not to second-guess your purchase, but was there a reason you didn't diversify across the brands to prevent a situation where they might all fail at once?
    - linsomniac 6y ago
      I'm reminded of those HP drives that would brick themselves after a certain number of operating hours. People had every drive in their RAID array fail at once.
      - zepearl 6y ago
        Ooook, ok, I got it - not a great idea to buy HDDs of the same brand => I'll try to remember this :) But: in such a case, having a normal raid5/raidZ1 or even a raid6/raidZ2, etc..., you might still get scrd by just having 2/3/4 such HP-drives in such a raid (that might be composed of 8/9/10 drives), right?
        ValentineC 6y ago
        > you might still get scrd by just having 2/3/4 such HP-drives in such a raid (that might be composed of 8/9/10 drives), right? That's true. Ah well, you know what people say: RAID is for high-availability, not a replacement for proper backups.
        zepearl 6y ago
- comboy 6y ago
  > have small numbers of Hitachi drives 25,000+ drives according to 2020 Q1 report in case anyone is wondering
- jlgaddis 6y ago
  > Oh, my other advice is: Avoid Seagate drives ... I've found Hitachi to be the most reliable ... but I've pretty much had universally bad luck with Seagate. Don't take this personally but this advice is fairly useless. For every person like you, who has "found Hitachi to be the most reliable" and "had universally bad luck with Seagate", there's someone else who has the exact opposite advice. Our opinions are shaped by our own experiences, of course, and (most of the tine) it's hard to change our minds or convince us otherwise. The (unfortunate) truth is that there's no one brand of HDDs that really is "the best" -- especially for all use cases! If there were, well, we'd all be using them by now and all of the other manufacturers would have already went out of business.
  - pfranz 6y ago
    Also, the bummer about the Backblaze stats is that they can't tell you about new batches of drives.
  - linsomniac 6y ago
    I would generally agree with you, but it comes from a decently sized sample set (not huge, a few thousand), but also because it seems to be backed up consistently by Backblaze's stats. :-)

cure 6y ago

But if you ZFS, avoid the crappy WD red SMR drives! Cf. https://www.servethehome.com/wd-red-dm-smr-update-3-vendors-bail-and-wd-knew-of-zfs-issues/ https://www.servethehome.com/wd-red-dm-smr-update-3-vendors-...