6 ms·
> importantly, for all SSDs, disable write-cache buffer flushing for best performance. Is this actually good advice, especially without mentioning the durabili
by vlovich123 6y ago
> importantly, for all SSDs, disable write-cache buffer flushing for best performance.
Is this actually good advice, especially without mentioning the durability risks?
- sushshshsh 6y agoThe biggest players in the game do not use SSDs for persistent storage longer than x weeks. It is offloaded to tape at some point and restored periodically.
- vegardx 6y agoUhm, what? There are tons of ways to prevent data loss, none of them involves writing the data out to tapes and then back in again.
- sushshshsh 6y agoSure, you can also write to disk or other media. But are you trying to argue that certain large companies don't use tape?
- vegardx 6y agoI never said that. There's simply no good reason to periodically write your data from flash to $other every now and them, and then back to flash. There are heaps of other ways to prevent data loss or performance degradation in flash storage. There are methods like tiered storage, where only the most active data is present in Flash-storage, much like write back caching.
- deleted 6y ago[deleted]
- deleted 6y ago[deleted]
- gruez 6y ago>It is offloaded to tape at some point and restored periodically. This makes no sense. The main problem with disabling write flushing is what happens if the OS crashes or the power goes out. Doing periodic backups/restores provides a "last known good state" to revert to, but you'll still lose all the writes between the last backup and when you crashed. Depending on your workload this might be fine, but I doubt the COO is going to be pleased when he finds out you lost all customer orders from today. The bit about "restoring periodically" also doesn't make any sense because such events are easily detectable. There's no need to constantly take the system offline to do a restore. Disabling write flushing isn't going to cause increased bitrot.
- duskwuff 6y agoExplicitly rewriting data periodically might make sense if you're really paranoid about flash fading over time. But bouncing the data through tape (tape!!) still makes no sense; the sensible way of managing this would be to mirror the data directly to another SSD.
- sushshshsh 6y agoWe are arguing about nothing. Live data (being accessed many times per day) stays on SSDs. The middle tier of data is a gray area and can go on SSDs or disk. But if you think that your FB or Youtube or Fidelity or Geico or SSN or IRS or Apple or Google data isn't sitting on a tape somewhere, you are extremely mistaken, because I was the one who wrote the tape control software they purchased from us.
- wtallis 6y agoNobody's denying that the data makes it to tape eventually. What everyone finds hard to believe is your assertion that data is ever moved from tape back into warm storage during the ordinary course of business. Enterprises use tape for backup. They only read data off tapes after something goes very wrong, or periodically to verify that their backup process is actually working. But except after a catastrophe, data read from tape is not routinely used to re-populate warm storage.
- motives 6y agoI'm also curious as to whether this is true. From what I understand and can gather from tech talks from large firms, it is common (up to and beyond petabyte scale) to use ceph clusters purely consisting of SSDs and HDDs (no tape) to store mission critical data, with cache tiering used to balance hot and cold data. AFAIK, because of their self-healing nature thanks to replication/erasure coding algorithms, all that needs to be done is replace corrupted drives periodically, thus making tape drives non-essential unless periodic full backups are required for off-site storage. Please feel free to correct me if I'm wrong in any of this. Thanks.
- nix23 6y ago>to use ceph clusters purely Exactly! Use ceph so you don't have to care about burning ssd/hdd/server/switch/racks/dc, you have your object-storeage, FS, block-device, with one service and that's it.
- saagarjha 6y agoThey use tape because they have insanely large amounts of data they want to store and no need to have fast access to them, not because they are a good replacement for SSDs.
- pizza234 6y agoStackOverflow answer here: https://superuser.com/a/1215634 https://superuser.com/a/1215634 It's essentially the typical "without this enabled, you will lose data in case of power loss, potentially breaking the O/S".
- jbverschoor 6y agoDont most SSDs have capacitors for this?
- JaimeThompson 6y agoOnly enterprise class drives typically have power loss protection and even that isn't a guarantee as some in that class don't have PLP.
- wtallis 6y agoAs far as I'm aware, server SSDs without PLP are a relatively recent trend, and most of the examples I'm aware of are entry-level SATA drives. A few companies are also marketing their client/consumer M.2 NVMe drives for use as server boot drives, but at least one competitor in that segment has made a purpose-built low capacity NVMe drive with PLP.
- maxerickson 6y agoIt's a tangent, but I only recently realized/considered that UPS batteries had come along for the ride with lithium-ion. I bought one that should power my internet+wifi for about an hour for $45. I guess even a small one like that would handle power blips for a home server, but in an outage the battery would quickly run out and the setting would matter.
- fgonzag 6y agoMost smart UPS can notify equipment (via LAN, USB and some even offer IPMI) to turn off in the event of an outage, or as soon as the battery reaches a certain threshold. You just need to install the UPS's server software on the equipment you want gracefully shut down.