7 ms·
Durability: NVMe Disks
- vbezhenar 6y agoAre there any consumer M.2 drives with guaranteed data protection (with capacitor or battery to flush all volatile data at power loss)? I did not find that kind of information in specs.
- throwaway8941 6y agoThis does not answer your question, but wouldn't it be easier to get a cheap UPS with enough battery life to get your machine through additional 5 minutes of uptime? Although I've had problems with hardware hanging so completely that it does not respond to the reset button, and the only option is to cut power, so UPS does not provide full protection.
- smolder 6y agoUPSs are never really cheap, since when converting AC to DC to AC you lose a significant amount of power efficiency for your equipment. The funny part is the server PSU then converts back to DC power yet again. My understanding is that well optimized data centers distribute conditioned, battery backed DC power directly to devices to avoid those double conversion losses.
- zrm 6y agoA small UPS will often have the equipment running directly on AC input power and only switch to the battery if the input power fails.
- smolder 6y agoOh, thanks for the correction. It seems I forgot that type existed or just never knew. Now I'm curious about the relative merits. I'd guess the transition is not as smooth and presents some kind of a risk that's unacceptable for critical infra.
- agapon 6y agoThe terms that describe those types are Line-interactive and On-line UPS. E.g., https://blog.tripplite.com/line-interactive-vs-on-line-ups-systems https://blog.tripplite.com/line-interactive-vs-on-line-ups-s...
- tuatoru 6y agoIt'd be good if consumer UPSes had DC output for this reason. If only laptops could be standardized in terms of voltage requirements. A lot of them are pretty similar; 19V - 21V seems quite common. Until recently phones were standardized on 5V. Now, it's a mess again. :-(
- smolder 6y agoI vaguely recall seeing someone modify their UPS for this in their "homelab", such that they were running a 12v cable modem, router and WAP off of the UPS battery pack directly somehow. They had dramatically longer run time from a full charge. (Well more than double, I think.)
- yencabulator 6y agoOoh, imagine a NUC or such small enough machine running off of USB-C Power Delivery. 65 Watt power budget easily. I guess a Raspberry Pi would count as that? Then a battery pack could provide that, as DC.
- wtallis 6y agoConsumer SSDs are very nearly defined as those that do not include the extra hardware necessary for such guarantees; the only other defining feature of a consumer SSD is the presence of low-power idle states. I'm not aware of any current or recent flash-based SSDs marketed at consumers that feature the same kind of power loss protection as enterprise SSDs. Intel's Optane SSDs don't need power loss protection capacitors because they don't cache writes—their 3D XPoint memory is more or less fast enough to not require it. These drives correctly advertise that they do not have a volatile write cache. I have not encountered a consumer NVMe drive that lies about having a volatile write cache, but I have not attempted to test how they behave when the host requests that the write cache be disabled.
- marcan_42 6y agoConsumer Crucial/Micron drives used to have enough capacitors on board to, at least in my understanding, never corrupt data on power loss (not sure if they flushed the cache, but I think they at least tried and guaranteed sectors wouldn't become unreadable/corrupted due to being partially written). They dropped this in later models, though, but I think they still claim they can guarantee non corruption/partial writes? I stopped trusting Crucial when they released the P1 though. That QLC drive is terrible on every metric. Performance falls off a steep cliff once you do any writes at all, and often never quite recovers. Tail latencies are in the 1 second range, which is insane for an SSD.
- ec109685 6y agoThese folks combine Intel 3D XPoint + QLC to deliver a two-tiered cheep storage solution: https://vastdata.com/ https://vastdata.com/
- loosescrews 6y agoIntel's "Intel® Optane™ Memory H10 with Solid State Storage" is an Optane/QLC flash hybrid drive with an NVMe interface and capacities up to 1TB. It claims to offer enhanced power loss data protection: https://www.intel.com/content/www/us/en/products/memory-storage/optane-memory/optane-memory-h10-solid-state-storage/optane-memory-h10-32gb-1tb-m-2-80mm.html https://www.intel.com/content/www/us/en/products/memory-stor... I found this review which makes it sound pretty reasonable: https://www.tomshardware.com/reviews/intel-h10-qlc-flash-optane-caching,6094.html https://www.tomshardware.com/reviews/intel-h10-qlc-flash-opt...
- PragmaticPulp 6y agoI doubt any consumer M.2 drives will have power loss protection. The additional cost and PCB space required for the capacitors is a non-starter in consumer drives where every cent counts. Server grace storage will specify if power loss protection is included on the board. You can usually identify the capacitors as well. For example, they are the yellow rectangles near the edge of this Intel SSD: https://ark.intel.com/content/www/us/en/ark/products/96932/intel-ssd-dc-p4501-series-2-0tb-m-2-110mm-pcie-3-1-x4-3d1-tlc.html https://ark.intel.com/content/www/us/en/ark/products/96932/i... Note that the Intel drive with PLP is 110mm long, which is 30mm longer than most consumer M.2 SSDs due to the additional capacitors. This won’t fit on certain consumer motherboard.
- kbenson 6y ago> This won’t fit on certain consumer motherboard. From diving into this recently in speccing out a budget system for myself, it looks to be mostly the lower end budget chipsets and motherboards that don't support it. At least that's what I've seen of the regular sized ATX boards, but it may be a different story for Micro-ATX or Mini-ITX. The relevant info is always in the specs, and will look something like: M.2 Slots 2242/2260/2280/22110 M-key 2242/2260/2280 M-key For each of those, the first two numbers are the width, the rest denote the length. So 2280 is 22mm x 80mm, and 22110 is 22mm x 110mm.
- fulafel 6y agoThe PSU will let you know in advance that power is going out. I think the interesting question is which SSDs have FTLs that can safely "park" in this time to a consistent state. Is there a standard for PSU's about how long they provide power, that SSDs could design to?
- wtallis 6y ago> Is there a standard for PSU's about how long they provide power, that SSDs could design to? Yes. The ATX power supply spec has timing requirements for the PWR_OK signal. As described on Wikipedia: > The ATX specification requires that the power-good signal ("PWR_OK") [...] remain high for 16 ms after loss of AC power, and fall (to less than 0.4 V) at least 1 ms before the power rails fall out of specification (to 95% of their nominal value). So power supplies are expected to continue operating through roughly a single missing cycle of AC power, but they only have to give the system 1ms of warning when power is going out. This signal would have to be delivered to the SSD by software in the form of a shutdown notification (a write to a particular NVMe register). And now that I think about it, that shutdown notification mechanism probably warrants inclusion in the article.
- fulafel 6y agoI see, didn't even know that the original ATX spec made any promises, I guess 1 ms is "something", strictly speaking :) I was hoping for a post-1995, more usable spec since we know that current PSUs often do provide power longer than 1 ms. A single AC cycle would be 16-20 milliseconds which could already be doable if the SSD got the signal right away without OS involvement.
- wtallis 6y agoI'm not sure that bit actually comes from the original ATX spec; Wikipedia seems to indicate it showed up in ATX 2.31 in February 2008. It does also appear to be consistent with the very recent Intel ATX12VO spec.
- dannyw 6y agoActually the Crucial MX500 SSD series had extra capacitors for power loss. Unfortunately they removed it for M.2.
- wtallis 6y agoThat wasn't the same thing. Crucial SSDs always had volatile write caches. What their MX series and at least some of the NVMe drives offer is the guarantee that data already on the flash will not be corrupted by a write that's in progress when the power fails. But that doesn't affect the semantics of writes that may still be pending in the volatile write cache. This potential failure mode is possible when storing more than one bit per flash memory cell, and using a multi-step process to program the cell voltage, and mapping the low-order bits of a cell's value to different LBAs than the high order bit. Drives need to have the capability to either complete or safely abort an in-progress cell program process so that the value in the high-order bit(s) isn't corrupted by an incomplete programming of the low-order bit(s). And this power failure problem isn't the only reason why SSDs need to be careful about leaving cells in a partially-programmed state.
- nh2 6y agoNot "consumer", but the only M.2 SSD with 80 mm length (M.2 2280) I found that has power loss protection is this one: https://www.kingston.com/en/ssd/dc1000b-data-center-boot-ssd https://www.kingston.com/en/ssd/dc1000b-data-center-boot-ssd
- wtallis 6y agoRather interestingly, despite obviously having a bank of large capacitors and conspicuous advertising of power loss protection, the firmware on that drive identifies it to the host system as having a volatile write cache.
- nh2 6y agoLast weekend my ThinkPad running ZFS on Linux on a Samsung non-power-loss-protected consumer SSD lost various files when it ran out of power (including the entire Thunderbird profile because its SQLite DB was corrupted). I'm planning to replace it by the SSD linked above. I was already aware of the power loss issue on consumer SSDs (from the 2013 piece http://lkcl.net/reports/ssd_analysis.html http://lkcl.net/reports/ssd_analysis.html), but I wanted to see it happen for real. I guess I did now.
- wtallis 6y agoYou'll probably experience a lot more unplanned power loss in your laptop by giving it a SSD that idles at 1.2W instead of one that idles in the mW range. And there's a real chance that it won't even solve your problem.
- sedatk 6y agoAssuming NVMe’s are mostly used with journaling file systems, why is this important?
- throwaway8941 6y agoJournaling cannot guarantee data or filesystem integrity if your hardware is lying to you. If you send flush to an SSD and it reports "ok, your data is on the persistent storage", while actually keeping it in DRAM buffers (to get higher numbers on benchmarks), and your power goes down, shit ensues. This is surprisingly common behavior.
- sedatk 6y agoBut as long as you write the journal entry first and the device guarantees flushes for writes in the order they are queued, there should be no inconsistent state at all?
- wtallis 6y ago> and the device guarantees flushes for writes in the order they are queued NVMe does not require such a guarantee, nor does it provide a way for drives to signal such a guarantee. (Part of the reason is that NVMe devices have multiple queues, and the standard tries to avoid imposing unnecessary timing or synchronization requirements between commands that aren't submitted to the same queue.)
- sedatk 6y agoI see. Then it makes sense. Thanks.
- jabl 6y agoAssuming NVME queing works like SATA or SCSI queuing (which I believe it does), then basically queue entries are unordered [1]; the device is free to process them in any order. If you (as in, person who is implementing a block layer or file system in an OS kernel, or some fancy kernel-bypass stuff) want requests A and B to be ordered before request C, then you must do something like 1. Issue A and B. 2. Wait for A and B to complete. 3. Issue a FLUSH operation (to ensure that A and B are written from the drive cache to persistent storage), and wait for it to complete. 4. Issue C with FUA (force unit access) bit set. 5. Wait for C to complete. Alternatively, if the device doesn't support FUA, for writing C you must instead do 4b. Issue C. 5b. Wait for C to complete. 6b. Issue FLUSH, and wait for the FLUSH to complete. Now, like wtallis already said, NVME additionally has multiple queues per device, but these are independent from each other. If you somehow want ordering between different queues, you must implement that in higher level software. [1] The SCSI spec has an optional feature to enable ordered tags. But apparently almost no devices ever implemented it, and AFAIK Linux and Windows never use that feature either.
- stjohnswarts 6y agoI assume the people who make NVME drives are much more knowledgeable than me on the topic. I just use drives as they come and don't obsess over how to get 5-10% more life out of them with tweaks. Your best bet is to buy a drive from a reputable brand and not one you haven't heard of before or at least haven't researched. As far as data, back up early, back up often.
- wtallis 6y agoThis article is not about a drive's total write endurance or lifespan, but about short-term durability of writes across events like unexpected power failures or system crashes.
- ncmncm 6y agoI had an Intel 6000-series 1/2 TB NVMe. After just 2 years of light, fitful use in my laptop, my BIOS warned me it was about to fail. I spent the night doing backups, and it totally failed the next day. I count myself lucky, but I did not replace it with an Intel product.
- wtallis 6y agoThat was kind of a trashy product. Intel doesn't take their client/consumer SSD business very seriously these days, and that was only halfway an Intel SSD. The controller was Silicon Motion's first NVMe SSD controller, the drive had numerous firmware bugs, and it was probably also a bit of a dumping grounds for low-grade flash from Intel's first generation of 3D NAND. The successor to that drive switched from three bit per cell TLC NAND to four bit per cell QLC NAND and still managed to be a superior product in almost every way because the updated controller and firmware were so much more mature.
- ncmncm 6y agoThank you for the clue. All the reviews I had read claimed Intel and Samsung SSEs were bulletproof, and everybody else's were trash. For $300, it should have been a better product. Only 6 months later the competition was getting only $100 for them.
- syshum 6y agoSamsung Flash storage I have always had great success with Intel I would only use Enterprise Class gear, and even then would look to other vendors for storage Intel trades off their name, and puts out alot of crap at the lower end which they get away with because "No one ever got fired for buying intel" Alot of these big names do this....
- willis936 6y agoIt's funny to see Intel tracing IBM's steps. It's tempting to think they sick of being successful. I think the real answer is ignorance of IBM/Compaq, lack of wisdom, and, the key ingredient: hubris.
- macdice 6y agoTo use reported AWUPF as a way to turn off MySQL double writes safely, I guess you need to be using direct IO (otherwise Linux's 4096 hardcoded buffer size kicks in) and you need to know that nothing in the IO stack can ever split up your writes in a way that could overwrite InnoDB pages non-atomically. How can we know that that is true of the whole IO stack? Is it even possible today, without something like the O_ATOMIC proposal?
- helltone 6y agoCan I have a reference for that hardcoded buffer size please?
- macdice 6y agoSee man pages for mkfs.xfs, mkfs.ext4. On other Unix systems block size is/was more variable, but on Linux you can't exceed the 4kB memory page size. So it is not possible to match database block size (typically 16kB for InnoDB, 8kB for PostgreSQL). (Exception being ZFS which has a completely different architecture and can do atomic writes.) Note that I am not saying buffered IO would necessarily be atomic at that level on (say) ancestral SGI XFS or FreeBSD UFS with block size matching the database's (I don't know if it might it some circumstances split writes on sector boundaries for some reason)! Just that it's already a non starter when the block size is too small.
- p_l 6y agodirect i/o forces 4k buffers too :/
- srtjstjsj 6y agoI had a old (2015 era) presumably cheap M2 drive in a "refurbished" Dell Inspiron laptop that one day after under year just refused to boot or be recognized has having block storage at all (couldn't reformat, internally not externally with a USB adapter). (I bought a cheap replacement that has worked fine since.) Could that have been caused by a sudden power loss that corrupted a key section or the drive?
- questionfor 6y agoWhat’s the most reliable non-NVME SSD for consumers?
- Shared404 6y agoGood question. I've found Samsung to be quite a good brand, as well as HP surprisingly. YMMV with HP though.