5 ms·
> And you should look really, really hard at retention when it is not powered (do the bits leak away, past recovery by ECC, when it's been on the shelf for six
by Someone1234 10y ago
> And you should look really, really hard at retention when it is not powered (do the bits leak away, past recovery by ECC, when it's been on the shelf for six months?)
Aside from the components physically degrading (or environmental factors like radiation), I've never heard, read, or experienced this issue. Why do you believe this SD card would be susceptible to data loss after as little as six months?
- jrockway 10y agoFlash is actually super lossy (especially non-SLC technology), it only appears to durably store your data because of error correction and redundancy. This is something I never realized until I worked on an embedded system where every bit error showed up as a log message. It made me think, "how can computers work at all"? The answer is math and abstraction layers that work a little bit better than the average web framework.
- TickleSteve 10y agowear-levelling and bad-block management are not magic. The failure modes of FLASH are well-known, they dont necessarily need abstraction layers and they do work very well and reliably.
- lallysingh 10y agoI think when someone on HN refers to a specific piece of tech as magic, they're not saying that it's literally magical.
- kabdib 10y agoFlash storage management is still hard to get right, especially when the power can be removed at any time. Making data structures resilient to arbitrary power removal while having good performance is quite a feat.
- jrockway 10y agoI used the word math, not magic. There are many abstraction layers involved. For example, your Linux application isn't bit-banging the NAND chips directly. Your SoC knows there's flash attached, and handles it accordingly. Or, the Linux MTD layer handles it. Then, there are the flash-specific filesystems, like ubifs. All in all I find it pretty interesting, because if you "echo foo > /dev/mtdX", you're not going to find any sequence of flash cells that contain the bit pattern 0x66 0x6f 0x6f 0x0a for very long after you do that write. And yet everything works anyway. There is a _high probability_ that you will be able to read it back, but there it's never guaranteed. Nothing is ever guaranteed. All we can do is increase the probability of success.
- StillBored 10y agoRight, and usually SD cards don't have anywhere the level of FTL's that SSD's have. In fact its likely there isn't much of a FTL at all, rather just a simple ECC on the flash pages. Lose more bits in that page than the ECC can correct, and the whole card is basically done because it can't relocate sectors. SD isn't meant to be primary storage. Its meant to be used more like floppies/usb sticks. I can't tell you how many android phones I "fixed" for a couple years by replacing the SD cards. I actually had a sandisk 128G fail on me a couple weeks ago, that was just sitting in a dell/windows tablet with little more than a few movies copied to it. It didn't last 6 months, I guess something in win10 must have been rewritting a date/time stamp or something similar to the same sector long enough that the card just started hanging doing reads until it became bad enough that windows would choke and I noticed it. Back about 10 years ago, I had an ARM device with an SD slot that I was writing firewall logs to. The SD cards in that machine would last ~2 months before they died. Eventually I replaced the SD cards with a USB attached SSD in an enclosure, and that fixed the problem.
- smhg 10y ago> that work a little bit better than the average web framework you have a reference for this? which aspects did you compare or were compared?
- bendbro 10y agoI think that was intended to be a joke, as when I think of the average web framework, I see buggy junk.
- kabdib 10y agoMultiple-bits-per-cell is astonishingly involved; with three bits the electronics has to distinguish between eight voltage levels in the face of process variations and environmental conditions that vary widly. There aren't that many electrons in these cells to begin with, and the charges leak over time. I think of the engineering that goes into this stuff as "heroic." 4 bits per cell and you're talking full bull-goose crazy. My hat's off to ya (no, I'm not going to buy any of that). So you ECC the shit out of things and hope. Or you use less ECC, get more "checkbox capacity" on the box the consumer sees, and most people won't experience failure until they throw the device away. It's all about margins. SSDs, even the expensive ones you buy, don't have a super long shelf life and are not what you want to use for backup media.
- FullyFunctional 10y agoThis, a million times, this. It's a stunning paradox that densities and adoption is growing dramatically all the while raw retention gets worse with every generation (an astonishing amount of smarts goes into mitigating media deficiencies). I'm not too concerned (assuming the standard backups) about devices in continuous and powered-on use, but for data at rest, powered off, this is very scary.
- kabdib 10y agoIt gets even more scary: So you back up all your data to disks? Sure, they're pretty cheap and you can buy a terabyte for fifty bucks, but guess what the firmware for those drives is stored on. Hope the flash they used wasn't cheap (but if it's a consumer drive and it cost you fifty bucks, it probably was). For long life I'm betting on DVDs (refreshed every few years). Easily half of the 15 year old drives I've been keeping are now bad; copying them forward every few years is a good idea. It might be time to go back to tape, but it's expensive. Pretty much everything sucks at retention.
- pathikrit 10y agoOr just pay $100/yr to back it up to Dropbox (or even cheaper AWS Glacier)?
- crzwdjk 10y agoBecause in a 3-bit flash cell, there are on the order of 10 electrons separating one charge level from the next. If a couple too many decide to quantum-tunnel their way to freedom, the bits will flip.
- DigitalJack 10y agoFlash is very heat sensitive. It doesn't take a lot of thermal energy to allow those trapped electrons to migrate. Lower temps need more time but can still cause loss, higher temps less time.