8 ms·
SSD as Long Term Storage Testing
- zeroping 4y agoSo, check back in 5 years.
- nubinetwork 4y agoI might be able to test this, I have a 4790k that I haven't touched in years...
- Aachen 4y agoI'm interested, but will OP deliver? Not sure I want to get my hopes up just yet :( Related, I was wondering how I'm going to learn of the results of the submitted article. Calendar reminder with a link to the blog perhaps? Putting my email address somewhere would be much preferred for me tbh but I didn't see any sign-up form.
- 0cVlTeIATBs 4y agoI had a Q6600 machine with some boot ssd, unplugged for years. Maybe a crucial vertex 4 128GB? Started right up like nothing happened.
- spockz 4y agoI’ve had some similarly old hardware that didn’t boot and a desktop that had been powered off over an holiday. Both had corrupt data but on the second one it was in a file crucial for windows to boot so I had to repair it. Data corruption can occur without notice.
- 411111111111111 4y agoAnd it's all pretty anecdotal with one digit sample sizes. I don't think this can really be answered unless we get something like the reliability report from blackblaze. Still, i hope I'll read about the final result of the article in a few years.
- Aachen 4y agoAnecdotal, yes, but having any data is a better indication than having no data. If nobody can find evidence of the phenomenon you know you're more likely fine (no guarantee) than when people start plugging in old drives and some discover rotting.
- lionkor 4y agoNice username! Im from/in Aachen ;) saw your meta comment as well on your name
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]
- Aachen 4y agoSent you an email btw, in case your ISP misclassified it as spam
- beauHD 4y ago> data needs to be validated regularly and cycled to a new media every 5-10 years in order to ensure it’s safe and easily accessible This is what I do. I hate doing it, but it's for posterity's sake. I'd be lost without certain data. I have old virtual machine disk images that I've been using for years, ISOs of obscure software, and other rarities. Every 4 years I buy a new 4TB HDD and copy over files to a freshly bought disk.
- justinclift 4y agoHang on, that sounds like you're copying critical data to a single disk? That's not actually the case is it?!?!?!
- Juke_Ellington 4y agoIt makes sense if you keep the old disks around until they kick it. You can always have 3-5 copies around in a decently readable state
- favorited 4y agoIf you're not periodically checking the data for corruption, and only moving from a single drive to a replacement single drive, eventually you'll have some corrupted data which gets copied from drive to drive without you noticing. 4 TB drives are dirt cheap. If someone would really be "lost" without this data, having some redundancy would be inexpensive and easy.
- lazide 4y agoIf stored on ZFS, at least it would be validated each time it was copied.
- kadoban 4y agoIf you keep a ZFS mirror of the most-recent N drives, and store them separately, that should be pretty good. I forget how ZFS behaves if a mirror is missing drives though, if some are off-site. Hopefully it's smart enough to let you do that and just rotate through.
- plebianRube 4y agoI've had magnetic drives with excellent data integrity that spent the last 20 years un touched in self storage units. I have read CD-RWs of approximately the same age with no data loss. SSDs sacrifice durability of data for io speed
- sebazzz 4y agoGiven the recent debacle with the Samsung SSD firmware, I'd love to read internal hardware and firmware engineer notes and concerns. I think there are quite a few bodies in the closet that is called the consumer SSD market. You'd at least hope that enterprise SSDs with a Dell sticker on them are better.
- eyegor 4y agoThe enterprise stuff is almost always longer lasting, but the only one that truly lasts is (was?) optane. You shouldn't trust an ssd long term, especially modern ones. I've probably seen 100 drive failures in total (hdd and ssd) and covid era ssds are garbage for longevity. The big downside of enterprise ssds (besides price) is performance. You can literally double your speed by buying consumer grade (and it's roughly the same price to buy 2 drives for every 1 enterprise grade).
- sekh60 4y agoConsumer grade drives have some fast cache in front of them and while initially crazy fast can't do sustained writes without allowing down.
- deleted 4y ago[deleted]
- zamadatix 4y agoThe article doesn't really support this claim. It argues SSDs sacrifice speed and durability for capacity and cost and then posits an unanswered question about absolute durability with an ongoing test to find out. I do wish the test had more than $13 TLC drives though.
- ipv6ipv4 4y agoThe longest lived data is replicated data. Making more copies, with some geographic distribution, is more important than the durability of any particular technology. This applies to everything from SSDs, HDDs, CDs, to paper, to DNA. If you want your data to last, replicate it all the time.
- jbverschoor 4y agoSounds like data is a living organism
- barelyauser 4y agoA virus has data. Is it alive?
- gymbeaux 4y agoWouldn’t that exacerbate bit rot?
- ilyt 4y agoMore chances of bit rot but many more chances of spotting it early and correcting, assuming copies are periodically checked against eachother and errors are corrected
- avi_vallarapu 4y agoGood luck with your tests. Nice article though.
- 71a54xd 4y agoI wonder if storing SSD's in a faraday bag or a thick steel box could prevent degradation caused by cosmic rays / errant charged particles passing through? Curiously, acrylic plastic is one of the best materials to absorb highly energetic particles https://www.space.com/21561-space-exploration-radiation-protection-plastic.html https://www.space.com/21561-space-exploration-radiation-prot...
- KennyBlanken 4y agoThat's like saying "let's put bulletproof vests on the ballistic gel dummies for our test on how survivable this particular bullet round is on the human body."
- wtallis 4y agoThe most practical highly-effective radiation shielding would be putting your drives in a waterproof container and storing them at the bottom of a swimming pool. That will also do a pretty good job of keeping the temperature stable and not too high.
- sgtnoodle 4y agoI don't think a faraday cage would help at all to stop any actual particles with mass? It seems like even a steel box would have to be rather thick to make a meaningful dent. Astronauts on the international space station are essentially in a solid metal faraday cage, and they see speckles in their vision each time their orbit passes through weak spots in the Earth's magnetic field. If you're really worried about cosmic rays, maybe you could try to figure out their predominant direction of travel for your location, then store your SSD in an orientation that minimizes its cross-sectional area. I naively assume they're coming from straight up?
- Robotbeat 4y agoInterestingly, unpowered flash memory has much higher retention rates at low temperatures and much SHORTER retention rates at elevated temperatures (the typical JEDEC spec is just 1 year retention at 30C unpowered). Flash memory in a freezer (assuming you don't have cold-induced circuit board failures due to CTE mismatch) could last hundreds of years. In a hot car, maybe a month. https://www.curtisswrightds.com/media-center/blog/extended-temperatures-flash-memory https://www.curtisswrightds.com/media-center/blog/extended-t... None of that is particularly surprising, but what's interesting is that write endurance can have the opposite effect... Writing at high temperature (followed by cooling to ambient... or lower) actually improves data retention over just writing at ambient.
- userbinator 4y agoIs the 1-year spec after all the rated program/erase cycles have already been used, so the flash cells are worn and much "leakier"? That's still rather disturbing, since I have datasheets for NAND flash from around 2 decades ago that specify 10 years retention after 100K cycles (although probably at 25C), and some slightly newer ones with 5 years / 1.5K cycles (MLC); and also explains the increasing secrecy surrounding the flash industry. The very few I could find for TLC don't even mention retention and endurance is vaguely specified, and refer you to some, probably super-secret, qualification report for the actual numbers. Then again, perhaps I shouldn't be surprised ever since they came up with the misnomers that are "TLC" and now "QLC", and nearly drove SLC to extinction. I don't want 3x or 4x more storage for the same price (or 1/3 or 1/4 the price) if it's 1/8th or 1/16th exponentially more unreliable --- that's how the physics works and there's no way around that --- but that's what they seem to be pushing for. You can get $13 128GB TLC SSDs as mentioned in the article but I don't see any $39 128GB SLC SSDs being made, nor $13 ~40GB SLC SSDs, despite the fact that such a device would have the exact same cost per NAND cell (and as a bonus, be much faster and simpler since SLC needs much less ECC and advanced wear leveling algorithms than TLC/QLC.)
- smartbit 4y ago> but I don't see any $39 128GB SLC SSDs being made, nor $13 ~40GB SLC SSDs Shouldn’t it be 2^3 times more expensive than TLC? IOW a $104 128GB SLC SSD or a $13 16GB SLC SSD. Edit: guess you’re right userbinator
- cantrevealname 4y agoI think it’s a mistake to test the worn and fresh disks at different intervals. I.e., testing worn disks in years 1 and 3, and fresh disks in years 2 and 4. Let’s say that the worn disks are found to have failed the hash check in year 1 and the fresh disks are found to have failed in year 2. Can you conclude that worn and fresh are equally bad? No, you can’t, because maybe the fresh disks were still OK in year 1 — but you didn’t check them in year 1. As another example, suppose the worn disks are found to be good in year 1 but the fresh disks are found to be bad in year 2. This seems like an unlikely result, but if it happened, what could you conclude? Well, you can’t conclude anything. Maybe worn is better because they are still good in year 2, but you aren’t checking them in year 2. Maybe fresh is better because the worn will fail in year 1.1 but the fresh last until year 1.9 before failing. Maybe all the disks fail in year 1.5 so they are equally bad. I think it’s better to test the disks at the same intervals since you can always draw a conclusion.
- NKosmatos 4y agoFully agree. The test would be better if all parameters are/were the same. Same set of data written (why put different GB on each SSD) and same testing periods. Nevertheless it’s an interesting little experiment :-)
- deleted 4y ago[deleted]
- petergreen 4y agoI wish I saw this in 2026!
- majkinetor 4y agoThanks for the laughs man :)
- Joel_Mckay 4y agoTo workaround the various tricks a drive can play, one may wish to use a capacity tester in addition to hardware stats. Fight Flash Fraud (f3) https://github.com/AltraMayor/f3 https://github.com/AltraMayor/f3 One could setup a destructive wear-test, but results may not be generalized between lots with identical model number. This is because some manufactures sell performant products for early reviews/shills, and eventually start cost-optimizing the identical product sku with degraded performance. As annoying as the bait-and-switch trend became, for off-brand consumer hardware YMMV. Good luck =)
- Dalewyn 4y agoKind of going on a tangent, but I think it's relevant so please bear with me: I never understood the point of cheaping out on storage media. Look, I get it. Most of us have budgets to work with, not all of us can afford enterprise 40TB Kioxia SSDs or enterprise HDDs hot off the presses. But if I actually, truly care about my data I'm going to at least shell out for (brand new!) drives from reputable brands like Samsung, Crucial, Seagate, Western Digital, Kingston, and so on. The ease of mind is worth the cost, as far as I'm concerned. What is the rationale behind buying used drives, or drives from off-brand vendors of unknown or even ill reputation? Aside from just goofing around, I mean. I never can justify the idea, no matter how strapped for cash I could be.
- dannyw 4y agoYou can never rely on a storage medium being perfect, so you must always plan for redundancy (e.g. ZFS, off-site backups). When you have that, cheaping out on storage doesn’t matter so much anymore.
- Dalewyn 4y agoI am assuming appropriate precautions are being taken, so that is beside the point. I'm talking about saving a dime on cheapo, non-reputable drives only to then spend extra time verifying they are actually fit for service. Why? Why would someone do this? I'm of the mind that buying a drive from a reputable vendor and saving yourself the time of verification and other red tape is worth the additional cost premium.