3 ms·

I didn't interpret you as judging. It is somewhat pathological I admit. The cluster is a bit more than 87% full, at 90% it slow to a crawl. I just asked my wife

by sekh60 3y ago

I didn't interpret you as judging. It is somewhat pathological I admit. The cluster is a bit more than 87% full, at 90% it slow to a crawl. I just asked my wife this morning if I could buy another hard drive (I buy 20TB seagate exos), and she suggested we delete some stuff. I find deletion of files when I do it psychologically stressful. So it is something I should get addressed, but I suppose we should be thankful I don't have dead cats lying around, lol.

detourdog 3y ago
I say you have saved it this long keep going. That drive seems to cost around $350. I use SSD drives for working storage and I use platters for archival. I believe the platters have a better recovery methods. Do you have any opinions? Thanks for more information.
- sekh60 3y ago
  I use enterprise SSDs for cloud images and VM volumes, I have about 7TiB useable of that. I don't know how data recovery from an SSD is, I think for a lot of issues you would have to replace the logic board and hope some sorcery works to figure out the ordering of data with wear leveling algorithms. Rust one can often recover data with something like ddrescue. I don't worry too much, with replica count of 3 for both flash and rust I can lose two drives with the same 4 MiB block and be fine, if the failing drives are within a chassis I can lose two whole nodes before I have data loss. I wish I had access to a tape library though, just it is hard to justify the upfront cost. My cluster has organically grown over the last ten years or so, making a huge near $8000 single purchase for a new tape drive, plus however much automatic tape rotation costs (I presume I need some sort of tape library for that? I have never used tape before) would be hard to justify.
  - bombcar 3y ago
    You can get used tape drives but no matter how hard I’ve tried to make it work it just really doesn’t, not for this stuff. You can spend that money on way more drives and increase the number of copies you have on and offline. As for automation the libraries aren’t much more than the drive, but you can also just manually load tapes if you had to.

by sekh60 3y ago

detourdog 3y ago

I say you have saved it this long keep going. That drive seems to cost around $350. I use SSD drives for working storage and I use platters for archival. I believe the platters have a better recovery methods. Do you have any opinions? Thanks for more information.

sekh60 3y ago
I use enterprise SSDs for cloud images and VM volumes, I have about 7TiB useable of that. I don't know how data recovery from an SSD is, I think for a lot of issues you would have to replace the logic board and hope some sorcery works to figure out the ordering of data with wear leveling algorithms. Rust one can often recover data with something like ddrescue. I don't worry too much, with replica count of 3 for both flash and rust I can lose two drives with the same 4 MiB block and be fine, if the failing drives are within a chassis I can lose two whole nodes before I have data loss. I wish I had access to a tape library though, just it is hard to justify the upfront cost. My cluster has organically grown over the last ten years or so, making a huge near $8000 single purchase for a new tape drive, plus however much automatic tape rotation costs (I presume I need some sort of tape library for that? I have never used tape before) would be hard to justify.
- bombcar 3y ago
  You can get used tape drives but no matter how hard I’ve tried to make it work it just really doesn’t, not for this stuff. You can spend that money on way more drives and increase the number of copies you have on and offline. As for automation the libraries aren’t much more than the drive, but you can also just manually load tapes if you had to.