19 ms·
Toshiba, Seagate shipping slower SMR drives without disclosure, too
- fendy3002 7y agoSo does this happened because the rising adaptation of SSD or it's bound to happen after all for HDD to cutting cost?
- lonelappde 7y agoIt's competition. Every cost cutting tech gets adoption except for boost the main muggle specs like capacity. On the SSD side we have DRAMless and TLC. The annoying thing is that unless the government forces disclosure, the honest manufacturers are the ones hurt, having to start advertising "no SMR!" to differentiate, like the organic/health food products in the grocery store that have to list all the poisons they don't have.
- segfaultbuserr 7y ago> On the SSD side we have DRAMless and TLC. I'm happy to buy a DRAMless + TLC SSD for my boot disk on my web browsing PC (not development), it is a reasonable compromise for a lower price. Same for SMR drives, I won't have problems with them as backup disks. I think the problem here is SMR drives are sold without disclosure, and it has already created some serious problems in practice. > What’s worse, they’re shipping DM-SMR drives as “RAID” and “NAS” drives This is causing MAJOR problems – such as the latest iteration of WD REDs (WDx0EFAX replacing WDx0EFRX) being unable to be used for rebuilding RAID[56] or ZFS RAIDZ sets: They rebuiild for a while (1-2 hours), then throw errors and get kicked out of the set.
- deleted 7y ago[deleted]
- magicalhippo 7y ago> They rebuiild (sic) for a while (1-2 hours), then throw errors and get kicked out of the set. I don't doubt it, but do you have the source for that? I read stories about people using the Seagate Archive disks in RAIDZ and it worked fine for them.
- cthalupa 7y agoMine completed the rebuild, but it took over 2 weeks vs. the usual 1-2 days my prior WD Red 6TBs had completed in. This has accelerated my move to enterprise 16TB drives, because I really don't want to expose myself to data loss on rebuilds taking hugely extended times.
- deleted 7y ago[deleted]
- zozbot234 7y ago> Mine completed the rebuild, but it took over 2 weeks vs. the usual 1-2 days This also means you'll need a lot more HD's per RAID set to guard against multiple failures during rebuild. Which means that even the supposed data density/space advantage of SMR is moot - you'd be better off with PMR.
- segfaultbuserr 7y agoSource was the article on the HN homepage yesterday, I thought most have seen it, but for those who missed it, here it is. * Western Digital admits 2TB-6TB WD Red NAS drives use shingled magnetic recording https://blocksandfiles.com/2020/04/14/wd-red-nas-drives-shingled-magnetic-recording/ https://blocksandfiles.com/2020/04/14/wd-red-nas-drives-shin...
- gruez 7y ago>On the SSD side we have DRAMless and TLC. Are you sure you're not talking about QLC? Current TLC drives can be pretty decent in terms of write speed and endurance.
- dannyw 7y agoYeah. QLC is bad but mature TLC with a DRAM cache can be an excellent choice b
- Nursie 7y agoQLC with a decent SLC cache seems to work just fine as well, for most consumer purposes - see drives like the sabrent Rocket-Q
- chx 7y agoI do not know whether it's actually possible but if you partitioned an 1TB Intel 660p to only 140GB and left the rest open would it make that into a 140GB SLC SSD? If so, then the 1 USD/GB for an SLC drive is an absolute bargain...
- Dylan16807 7y agoQLC with SLC cache is probably the best analogy for these drives, too. Some workloads will never have a problem, others will hit performance walls.
- 7y ago
- LeifCarrotson 7y agoThis, plus the previous post about the WD Red drives, makes it all three manufacturers - there are no honest options left. It's like saying "honest telecoms". Also, "boost the main muggle"? I usually think I know my Potter references, but this one escapes me.
- penguat 7y agoTry reading it as "muggle specs" - specifications which the majority of the population will read.
- Tijdreiziger 7y agoThere are honest telcos - usually cooperatives or foundations rather than for-profit corporations.
- userbinator 7y agoYes, the NAND flash "decline" (for lack of better words) is sad to see, and it's as you said --- the only marketing spec people seem to care about with storage is capacity. TLC and QLC are misnomers, a TLC cell holds 3 bits but has eight levels and QLC likewise 4 bits with 16 levels. You get a multiplicative increase in capacity for an exponential decrease in reliability. The manufacturers have been very obfuscatory with the marketing, since they know the inconvenient truth. Does anyone still make a reasonably large (>100GB) SSD with good old 100K SLC? I have a 64MB (true 2^26 bytes capacity!) flash drive with 100K SLC; 0 bad blocks when it was new, and still 0 bad blocks a decade and a half later despite plenty of abuse.
- hakfoo 7y agoThis feels like it could be managed in firmware. It's been well established that many modern SSDs will use a large volume of the NAND in a SLC style mode for performance reasons, and only switch to MLC/TLC/QLC mode as the available space to do so runs down. I would be curious what effect that has on reliability-- if an individual QLC flash cell goes bad, is it still typically usable if you're using psuedo-SLC coding? To go a bit further, I'm amazed you don't see a drive manufacturer offering an enterprise-client "firmware builder" tool, or at least as a build-to-order service if you're a big enough client. I could see customers that wanted to respec their 1TB drives as, say, 750GB to ensure an abundance of over-capacity for reallocation later, or the YOLO "I'm gonna run the cheapest drives in RAID0" crowd slashing overprovisioning and getting 1050Gb out of the same unit. If you dialed down the capacity low enough, the drive could presumably stay in "use SLC mode only" mode for its entire duration.
- userbinator 7y agoThe main issue I have with increasingly complex firmware is that it's also a source of bugs; they might not show up in normal usage, but any unusual edge-cases that result in data loss are catastrophic. I'm amazed you don't see a drive manufacturer offering an enterprise-client "firmware builder" tool, or at least as a build-to-order service if you're a big enough client. If they do, you probably wouldn't hear about it --- and I suspect they do, given that there are things like this: https://superuser.com/questions/593303/hitachi-hard-drive-with-apple-firmware-possible-to-install-windows-on https://superuser.com/questions/593303/hitachi-hard-drive-wi...
- LeifCarrotson 7y agoIs there any way small-scale ~4 drive NAS or file server systems can accommodate SMR drives in software? It looks like they're going to need to do so...
- magicalhippo 7y agoA small-scale NAS implies home usage, which again implies plenty of idle time. With plenty of idle time, the SMR drive should perform decent enough, as the drive has enough time to shuffle stuff between the persistent cache region and the SMR region. Or at least that's the theory.
- ubercow13 7y agoThey have problems being chucked out of pools when resilvering, ie. when added to the pool, so the general usage pattern isn't so much the issue as is the way the filesystem or RAID controller reacts to them. In particular I think people have had problems with ZFS because the resilvering process involves a lot of random writes, and once the PMR cache on the drive is full, it will stop responding as it flushes the cache for long enough for ZFS to think it's dead.
- LeifCarrotson 7y agoSo we could make the build process pause until the drive resumed responding, or have the ZFS/whatever filesystem drivers recognize the difference between a dead drive and an SMR drive that's working on its cache? I'd want the drive statistics or benchmarks to include a complete rebuild process, though.
- ubercow13 7y agoYeah, it does seem like maybe there could be improvements on the filesystem/RAID software side to better support these drives. If only they were labelled properly as SMR so that the filesystem devs could buy one to test with.
- 7y ago
- aasasd 7y agoIs there a trusted hdd manufacturer left? I'd like to not spend several weeks on research when I again get the urge to rebuild the NAS.
- Filligree 7y agoNo, this names all three.
- segfaultbuserr 7y agoWikipedia has a great diagram showing the process of hard disk drive manufacturer consolidation that tells a lot: https://en.wikipedia.org/wiki/File:Diagram_of_Hard_Disk_Drive_Manufacturer_Consolidation.svg https://en.wikipedia.org/wiki/File:Diagram_of_Hard_Disk_Driv... Now it's a perfect oligopoly: Seagate, WD, and Toshiba, just like the stories from many other industries.
- rasz 7y agoIts a guaranteed 30% profit margin industry with very high patent moat. No incentives to change anything.
- noisem4ker 7y agoThe article mentions thin margins and declining volume due to SSDs. I wonder where the truth lies. Anyway, I'd rather data-starve for a couple years and save up for a big SSD rather than feed those responsible for such consumer-hostile practices.
- folmar 7y agoNot that SSD vendors are much better... see other comments in this post.
- chx 7y ago> Its a guaranteed 30% profit margin industry While I was surprised by that figure https://www.seagate.com/ca/en/news/news-archive/seagate-technology-reports-fiscal-fourth-quarter-2019-financial-results-pr/ https://www.seagate.com/ca/en/news/news-archive/seagate-tech... this corroborates, with margin figures indeed roughly 30%-ish.
- Havoc 7y agoCan't say I particularly care frankly. I don't see myself buying another spinning plate of rust
- segfaultbuserr 7y agoHow do you backup your motionless piles of sand, then? /joke Perhaps all the data you care is on the cloud, but HDDs are still important for backups. Although it's the most acceptable scenario to use an inferior SMR disk. The real issue of SMR is RAID/servers, which, of course, is what the cloud is made of...
- votepaunchy 7y agoIf the cloud ever used RAID, the switch to erasure coding happened a long time ago. With Zoned Storage for SSD and HA-SMR for HDD we are Further seeing adoption of these novel technologies in the cloud.
- speedgoose 7y agoI do my backups in the cloud, which uses hard drives for slow storage but I couldn't care less about it. The terrible reliability and performances are not my problem anymore.
- jennyyang 7y agoWhat if you lose your job and can't afford to keep paying the monthly fees, or there is corruption in your backup? You won't know until you perform a disaster recovery.
- speedgoose 7y agoIf I lose my job I get notified in advance and then I get unemployment benefits for years. It's more than enough time to find a new job before I don't have enough savings to justify cloud storage costs. What if you connect your hard-drive and the data is corrupted or the drive isn't spinning? That did happen to me. I rather have people replacing the hard drives for me. Uploading corrupted backups to the cloud is the same than saving corrupted backups locally.
- DeathArrow 7y agoTrying to pass SMR as PMR is kind of pointless since HDD becomes more and more pro and enterprise territory and consumer are shifting away to SSD. Their customers are increasingly likely to be the kind of people who care about this kind of thing.
- baybal2 7y ago> pro and enterprise territory This doesn't change the fact that enterprise customers are equally screwed by DMSMR drives. Adding insult to injury is that those disguised SMR (DMSMR) drives were made with very intention to sell "unsalable" SMR drives to Windows users.
- wjnc 7y agoI read parent as saying that trying to cut corners with SMR is even more stupid seeing that the HDD-market is becoming 'more enterprise' on average.
- wtallis 7y agoSMR drives have more of a place in the enterprise market than the consumer market, just like tape drives. Enterprise/datacenter customers tend to have a much better understanding of their workloads and are more able to determine when they have a use case for niche technologies. They also have a greater ability to deploy tiered storage with SSDs in front of hard drives to cover up the performance limitations.
- p1necone 7y agoYeah but they need to be told the drives are SMR to be able to make that decision.
- jasonlingx 7y agoIf customers cared enough, wouldn’t someone just market their drives as PMR and this would solve itself? It would make sense to have a lower cost alternative that would fulfil most consumer needs though.
- Exmoor 7y agoI can't speak for the drives mentioned in this article, but the WD Red drives were de facto marketed as PMR since the Red line was marketed by WD as the best drives for NAS. It'd be a little like if you went down to the your local Ferrari dealership and bought a Ferrari only to find that they'd started selling a model that couldn't reach 60mph.
- otterley 7y ago> WD Red drives were de facto marketed as PMR Do you have a reference? Or any evidence of customers knowing or caring about the internals of the drive before this controversy arose? Claiming that anything is the "best" at something is pure puffery, as we say in the legal trade. Ferrari publishes quantifiable specs on how their vehicles perform; WD does not do so in detail.
- dragontamer 7y agoSMR is terrible for NAS setups, particularly RAID5. Absolutely terrible. Under no circumstances should you be putting an SMR drive into your NAS.
- canada_dry 7y agoAdding to this confusing debacle is how HDDs are now being marketed like running shoes: one type for running, one for squash, one for tennis, one for basketball...
- dragontamer 7y agoThere are only maybe... 3 or 4 elements of HDD designs worth talking about. * CMR/PMR drives -- Classic hard drive you've been buying for the last 30 years. Not much to say about it. * SMR Drives -- "Shingled" has very poor write performance, but adds 20% more capacity at lower costs. For "write once, read many" workloads, like archival or backups. This is because "Shingled" drives write data on top of the old data, so that your data is physically overlapping at the microscopic level. Any write must read the old data, rewrite the old data, and then finally write the new data you're planning to store. * 5400 RPM vs 7200 RPM -- Higher RPM drives are obsolete, because SSDs are faster. 7200 RPM is kind of standard, but 5400 exists for those who want less noise, less electricity usage, and are willing to put up with the lower performance. That's pretty much it. "NAS" drives tend to have anti-vibration sensors and other such things, but those sensors don't really cost much and I don't really see why it deserves its own category. ------------- There only needs to be maybe, 3 kinds of hard drives made today. 7200 PMR drives, 5400 PMR drives, and finally 5400 SMR drives.
- m0zg 7y agoI don't know if there's any truth to this, but I've read NAS drives also declare themselves "bad" much more readily through SMART, so you replace them sooner.
- moonbug 7y agoThe point is that the fault recovery is delegated up for handling at the array controller level, rather than being processed by the drive.
- wtallis 7y agoNAS drives will more readily return errors for individual IO commands. That's not the same thing as the drive saying it has failed generally, though primitive RAID controllers often treat any IO failure as a whole-drive failure.
- otterley 7y agoAre the disk vendors publishing performance metrics that are being violated by the use of SMR technology? Or is this just one of those cases of performance generally not being as good as it used to be, and customers becoming reliant on past behavior despite the lack of an explicit performance promise from the vendors?
- dragontamer 7y ago> Are the disk vendors publishing performance metrics that are being violated by the use of SMR technology? Not really, no. SMR drives overlays data on top of each other, like "shingles" on a typical American roof. As such, whenever an SMR drive writes data, it must read the data "underneath" the current spot, rewrite the "underneath" data, and then lay the new data on top of it. SMR drives are great for archives (write once, read many). But they're pretty much useless to the typical consumer. SMR drives should be avoided if you're building your own computer.
- otterley 7y agoI think the real answer here is to demand that disk manufacturers publish performance specifications. This leaves them free to change implementation details (which consumers usually don't know or care about) as long as the published specifications are accurate.
- dragontamer 7y agoFor literally years, people bought WD Red drives, DESPITE being more expensive, because they had higher performance. WD Blue drives had SMR / Shingles in them. WD Green drives were shoddy, low quality, and had issues with RAID Rebuilds. WD Red commanded a high price, but came with higher quality. What's happened here, is that WD has begun to sell low-performance drives under their high-priced "Red" brand.
- ric2b 7y ago> SMR drives are great for archives (write once, read many). Isn't that the wrong way around? Archives are write many, read maybe. I do regular backups that I hope I never have to read.
- thequux 7y agoThe annoying part about all this is that I want to buy some SMR disks (HM ideally, but HA will do) to experiment with storage tech. I know that there are lots of devices out there that are SMR internally, but because of vendors hiding the information, I can't actually buy what I want. (On that note: if anybody has a disk that supports ZAC or ZBC and wants to get rid of it, I'll happily buy it off of them)
- DeathArrow 7y agoGoogle the exact drive name and SMR. People have started to put together lists.
- Arbalest 7y agoThe parents point was that, by hiding disk type, they are intentionally device managed, not host aware (HA) nor host managed (HM), so do not fit the bill.
- basicplus2 7y agoHow to tell if a drive is a shingled SMR drive... it has TRIM support https://support-en.wd.com/app/answers/detail/a_id/25185 https://support-en.wd.com/app/answers/detail/a_id/25185
- cmurf 7y agoI'm not sure about how to moderate the reported DMSMR behaviors reported in this thread. But I wonder if folks are better off buying host managed or host aware drives instead, and pairing it with either dm-zoned and their preferred file system; or a file system that supports ZBC and ZAC natively (Btrfs does, I'm not sure about others). Note that dm-zoned has significant changes starting with kernel 5.5. https://zonedstorage.io/linux/dm/# https://zonedstorage.io/linux/dm/#
- p1mrx 7y agoThey should just sell PMR drives, with an option to enable SMR mode for extra capacity.
- marcan_42 7y agoNot possible. Modern drives require precision external equipment to write the servo markers, you can't "low level format" a modern drive and haven't been able to for about two decades. Changing from SMR to PMR would require rewriting the servo tracks for the different density.