7 ms·
Big leap for hard drive capacities: 32 TB HAMR drives due soon, 40tb on horizon
- techdragon 3y agoThis is cool, but I really need to hear more about how I can effectively use these kinds of drives in storage pools and backup applications without issue. I didn’t have time to learn back when the first disaster hit with SMR drives got snuck in without warning and we had a small outrage event. I’m happy for new drive tech but I’ve not seen much about the pros and cons of HAMR in real world use yet. Which could be because there’s no difference from traditional Perpendicular Magnetic Recording (PMR) hard drives, but then again it could have its own subtle set of trade offs entirely different to the ones that Shingled Magnetic Recording (SMR) drives do.
- jiggawatts 3y agoFrom what I’ve heard, these are primarily sold to the hyperscalers like the public clouds, Drop Box, etc… At their scale it’s easy to utilise these efficiently despite the limitations. They’re not very good in a small NAS or disk array. You’d need a big write cache in front of them and an OS that natively understands the sector groupings.
- techdragon 3y agoThis is why I’m looking for more info. This is talking about how they are already sending these out to Hyperscale customers, and they will eventually be in individual customers hands… so it would be good to know what file systems and cache setups are needed in order to benefit from this. I used to just rely on FreeNAS but it’s not as straightforward anymore. I’m having to consider Linux and looking at bCache FS and ZFS vs BTRFS and how all this compares on an all PCIe (m.2) flash drive setup… where a drive (or two) at this sort of size (~50TB) would make a great second backup copy of the flash array that can be started and stopped to periodically make the backups to save power… but then you have to think about copy efficiency since I don’t want to have them wasting read bandwidth from the flash drives… and the best is usually like to like file system copy ZFS -> ZFS and BTRFS -> BTRFS … so it adds another complication into a mix that is already far from simple. So it’s become something I’m keeping an eye out for… hopefully before it becomes something I may purchase, someone will have already done a good writeup.
- wtallis 3y agoThe simple answer is that the software stack necessary for consumers to effectively use these storage devices does not yet exist. Hyperscalers are pretty much defined as the ones who are big enough to do their own software stack. For the rest of us, we have some good components to work with but also some major gaps that won't be filled anytime soon. ZFS is a great improvement over traditional hardware RAID systems, but is still in many ways clearly a descendant of them. BTRFS has a slightly different mix of features from ZFS that make it a bit more flexible and a better choice for consumers who don't buy drives by the dozen. Neither has a great solution for caching/tiering with SSDs and hard drives. Ceph has a lot of features that would otherwise be almost exclusive to the hyperscalers, but is too complicated for something like a turnkey NAS. bcachefs aspires to eventually have most of the features you would want for a non-clustered storage system. Zoned storage is something many of the above already have some degree of support for, but as a paradigm it has not even started showing up in the consumer computing ecosystem so many of the issues with adopting zoned storage for consumer systems aren't even being worked on.
- XorNot 3y agoZFS has the concept of a separate intent log device though, I wonder if that would be enough to make these types of disks work with it? I have no problem putting a couple of terabytes of flash in front of a ZFS array if it means I can have 40TB of redundant storage in 3 disks.
- wtallis 3y agoThe ZFS intent log is an example of a supremely disappointing, underwhelming way to integrate SSD storage into your system. Fundamentally, it's just a workaround for the fact that most of the write caches preexisting in the storage stack are volatile caches and thus not safe. Putting the ZIL on an SSD allows you to get the safety without sacrificing the performance benefits of the write caching (performance that everyone has come to rely on). But the ZIL doesn't help with read performance, and the data you write to it is never even read unless you have a crash or power failure. And then for the read caching, ZFS has L2ARC as an entirely separate feature. So ZFS does technically have ways to take advantage of SSDs to improve a hard drive storage array—but I don't think anyone would consider it to be an ideal solution, more of a pragmatic minimum viable feature.
- crabbone 3y agoBig disks present a problem in the cloud provider environment: users typically want to partition them into smaller logical disks... but this means that larger disks must also have lower latency / higher bandwidth to service multiple users at the same time. Most likely, cloud vendors have a large choice of sizes to try to match requested sizes of logical disks to physical disks, but if most users don't want / need disks that are this big (or bigger), then the provider will have a problem.
- bombcar 3y agoBig disks have their place; both as selling "large bulk storage" to cloud users (most cloud systems use SSD as the "main/OS" drive now anyway) but also as near line backup storage.
- pclmulqdq 3y agoI am not entirely sure that HAMR will be too different from CMR/PMR drives. The premise of HAMR is that they heat the area under the head, expanding it, for reads and writes, and otherwise they are essentially CMR devices. This isn't like SMR, which had huge implications for drivers (due to the overlap in the bit lines). There must be a significant durability cost to HAMR, but I don't think the difference in drivers will be nearly as big for HAMR as it was for SMR.
- robotnikman 3y agoI'm guessing then that they will probably use a little bit more power then, but otherwise similar to CMR/PMR in performance. That heated head element though seems like a massive point of failure, though I have no idea how durable the technology it.
- dgacmu 3y agoThe heating is done by a solid state laser diode. It should be very reliable other than adding one more thing to an already complex drive head. (Which undoubtedly means the first generation or two will have some kinks to work out, but that's not a fundamental decrease, just engineering). And there shouldn't be much of an impact on durability. The heating is very brief - a nanosecond or so. The idea is not to expand the material physically, it's to increase its magnetic permeability temporarily so that you can write the bit to it and then it becomes stable again.
- rainbowzootsuit 3y agoThe nanoscale heating manipulates the magnetic coercivity of the platter coating to allow the magnetic polarization to be manipulated. It seems somewhat analogous to modern day Magneto Optical but much finer scale and the readout is via a magnetic signal vs MO using an optical readout.
- deleted 3y ago[deleted]
- metadat 3y agoI hadn't read all the details behind HAMR before. Fancy tech. https://en.wikipedia.org/wiki/Heat-assisted_magnetic_recording https://en.wikipedia.org/wiki/Heat-assisted_magnetic_recordi...
- lmpdev 3y agoI remember reading about HAMR a few years ago Why does memory and other hardware tech always seem to magically come to fruition? At least compared to software Is it because they're more conservative in their announcements? More certainty in a path forward? More $$$?
- celeritascelery 3y agoIt seems like it was doubtful this would come to fruition, at least in 2013. There are many promising technologies that that never become economically viable. But necessity is the mother of invention.
- wmf 3y agoI'm not sure what you mean by magically. For every tech that makes it to production there are one or two others that don't and people just forget about them. For example, storage roadmaps used to show bit-patterned media. Phase-change memory would have been nice to have too.
- magicalhippo 3y agoI recall reading about holographic storage[1] back in the 90s, was supposed to become a big thing "real soon". [1]: https://en.wikipedia.org/wiki/Holographic_data_storage https://en.wikipedia.org/wiki/Holographic_data_storage
- Twirrim 3y agoThere's whitepapers and articles every few years on Holographic storage, it's one of those perpetually just around the corner things. See also memristors, that HP in particular have been saying is coming in the next couple of years, fundamentally changing the entire computing industry, for decades.
- fb03 3y agoReminder: Have backups. Imagine losing 32TB of data in one go.
- Dalewyn 3y agoReminder: RAID is not a backup. You're going to have more drives die while you're resilvering 32TB of data.
- XorNot 3y agoBut "RAID is not a backup" is not related to this problem though. "RAID is not a backup" s a reflection of the fact that your RAID array is in one location, and instantly mirrors all data copied to it. A disaster to your storage array outside of a disk failure, will annihilate all your data (and this used to include "RAID controller dies"). The practical issues of RAID rebuilds also don't quite work that way - the "drives die while rebuilding problem" has two components: (1) is that beyond a certain size, the risk of bit-error while resilvering becomes a certainty due to all the data you're reading - ZFS fixes this problem with it's checksums basically. (2) If all your disks were installed at the same time, then the chance of another disk failure is high because they're likely all in the same part of the mean-time-to-failure distribution. (3) the risk of an error is higher because you're doing a lot more activity then normal, and so the additional stress is increasing the chance of triggering a failure.
- HumanOstrich 3y agoDo you not regularly scrub your arrays to surface these issues promptly?
- mbreese 3y agoWith 32TB, nothing would be done “promptly”. Can you imagine how long resilvering this drive would take? These aren’t feasible for RAID setups…
- Dylan16807 3y ago
- WalterBright 3y agoNow the NSA will have enough storage to keep all that surveillance video of me watching The Munsters.
- ww520 3y agoEnough for 18 surrounding cameras in 3D for 360 angles recorded in 120fps for 8k VR videos? Times 7 billion people times 24/7.
- detrites 3y agoI admit I wasn't particularly careful calculating this, but something like a quadrillion petabytes per year. I guess the datacenter would also need to be quite large, depending how vertical it could go. Say, a continent per year? Your move, NSA.
- mikerg87 3y agoIs it going to be hamstrung by SATA III? It would take roughly 13 hours to fill the drive at 6 Gbps…
- wtallis 3y agoOnly if it's a multi-actuator drive. Single-actuator drives are still barely hitting SATA II speeds, so this density boost on its own probably won't be enough to increase performance to the point where SATA III's 6Gbps is a real problem.
- dsr_ 3y agoYou get some data throughput increases by increasing areal density and number of platters -- the days of counting on 100-120MB/s from a spinner are now replaced by checking to see whether you get 220-280MB/s -- but you should not expect the rotating disk technology to push the SATA III standard just yet. It will be more than 13 hours.
- lostlogin 3y agoAdding an 18TB to a small Synology array takes days as it is. Adding a drive this size would take at least a week I think.
- Hamuko 3y agoThe biggest problem that I have with adding big drives to my NAS is the amount of prep work. badblocks takes fucking forever against bigger drives. It was like, 5 days to run three passes of badblocks against a 12 TB drive or something?
- bombcar 3y agoIs it even worth running something like badblocks before adding drives anymore? I guess if you want to be absolutely sure it's "clean" but most drives do intelligent remapping internally anyway, so "add and scrub afterwards" may be the way to go.
- m3kw9 3y agoSince it’s heat assisted I wonder how much the drives will heat up server racks?
- dannyw 3y agoThe heating is to a tiny area. It’s 0.2 watts or so. So, it won’t heat up server racks as normal HDDs use 8-15 watts.
- Scaevolus 3y agoIncredibly tiny areas are being heated for tiny lengths of time, so it has negligible effect. https://blog.seagate.com/craftsman-ship/hamr-next-leap-forward-now/ https://blog.seagate.com/craftsman-ship/hamr-next-leap-forwa... > Power, heat, and the reliability of related systems is equally nominal. HAMR heads integrated in customer systems consume under 200mW power while writing — a tiny percentage of the total 8W power a drive uses during random write, and easily maintaining a total power consumption equivalent to standard drives.
- vlovich123 3y agoDo HAMR drives have the same access pattern behaviors as normal spinning disks (eg sequential seek preferred to random)?
- winrid 3y agoI suspect so, they're still an arm that moves across the disk. It just also has to heat the surface for reads, evidently. It will be neat to know if there's a warmup time for writes.
- deleted 3y ago[deleted]
- xbmcuser 3y agoSSD prices at last seem to have an effect on hdd prices and capacities. We have almost had a decade of stagnant hdd prices and capacities. But it started to change as soon as ssd price per tb got close to hdd prices. I think we are back to a point where every 2-3 years the price of hhd/tb drops regularly as larger hhd drives are added.
- bombcar 3y agoDo hard drives have any advantage over SSDs anymore beyond cost per terabyte?
- sampa 3y agothey don't lose information after a couple of years sitting on a shelf
- bombcar 3y agothey also fail somewhat predictably in some situations (they start clicking before they die) but more and more I've noticed they just stop working.
- alwayslikethis 3y agoEssentially no, but the difference is enough that you would use HDDs in any situations where you can afford to deal with the shortcomings of HDDs.
- justsomehnguy 3y agoYou can write on them 24/7. DWPD isn't great, but TBW is almost limitless. Also sequential workloads doesn't suffer from the write amplification and remain pretty high even if you are writing for hours.
- magicalhippo 3y agoAs my NAS expands, I get more and more cold data. Meanwhile large SSD's are getting cheap-ish (even TLC variants). Are there any good options right now for multi-tiered storage for the home lab? LVM has writeback cache as an option, but I couldn't quite figure out how reliable that is, found some old posts with disturbing issues but not a lot of recent talk. Would also need to run ZFS on top of it for the ZFS features I rely on like snapshots and such, so feels like a Jenga tower solution. I know Ceph has this option, but Ceph performance is abysmal for small installations from what I could benchmark. Bcachefs looks like it'll be a winner, but it's still WIP so won't trust it with my precious data quite yet I think.
- codemac 3y agoThe idea you want tiering... at home.. just seems so unlikely to save you any serious money, or gain you significant performance. "tiering" in the traditional sense isn't even popular in the DC with things like Vast, Pure, etc all doing well. Is there any reason you don't know the data set that is generally cold? The vast majority of home users basically have data that is trivially super cold that needs reasonable read performance - this is just HDDs. Then have a second mount point with things that you need greater performance, and have that be just SSDs.
- the8472 3y agoHaving frequently used file metadata on SSDs while the cold parts are on HDDs would be noticeable even at home; the moment you start browsing the directory tree.
- seized 3y agoZFS on Linux has exactly this, you can specify specific devices to hold metadata. Caveats apply, you need to mirror those devices for redundancy. https://openzfs.github.io/openzfs-docs/man/7/zpoolconcepts.7.html#Special_Allocation_Class https://openzfs.github.io/openzfs-docs/man/7/zpoolconcepts.7...
- magicalhippo 3y ago
- lyu07282 3y agoThis is really exciting news, there hasn't really been any big leaps in HDD capacities in a long time, +12TB perhaps even +20TB in one generation is huge. I hope they are going to be reasonably priced, but given the competition has nothing, 1k+? I really hope not.
- jl6 3y agoThey will probably be competitively priced per terabyte, which will make each drive an expensive component. There will also be a small margin for the convenience of having a single drive rather than multiple drives, and an “early adopter tax” because it’s new tech. So yes, a 32TB unit is very likely to debut at >$1k.
- lyu07282 3y agoa 20TB seagate is ~$350 right now, so >$1k would not be "competitively priced per terabyte". But I still agree that its likely going to be >1k because storage density per disk is also a factor (and greed obviously).
- krasin 3y agoSomewhat related: 1TB optical discs for $3 from Folio Photonics (possible vaporware alert): https://www.techradar.com/news/exclusive-blu-ray-successor-will-cost-dollar1-per-1tb-disc-but-youll-need-a-dollar3000-drive-as-well https://www.techradar.com/news/exclusive-blu-ray-successor-w...
- ksec 3y agoThis isn't exactly new, goes back to as far as [1] 2007 on Ars, and they reported something similar from the same startup [2]. I do wish them success though. Even a Single TB disc would be 10 to 40 times the current Blu-Ray. It would be nice if they could do a mini cartridge version ( 6 Folio Mini Disc inside a Cartridge ) like Zip drive with 2TB for consumer. Unless you are a Data Hoarder 99.9% of the consumer could have their own backup down with a few of these cartridge. And in theory they should last a lot longer than HDD or even SSD. Really wish this isn't a pipe dream. [1] https://arstechnica.com/gadgets/2007/08/new-dvd-sized-disc-to-hold-terabytes-of-data/ https://arstechnica.com/gadgets/2007/08/new-dvd-sized-disc-t... [2] https://www.storagereview.com/news/folio-photonics-working-on-optical-discs-of-the-future https://www.storagereview.com/news/folio-photonics-working-o...
- bunga-bunga 3y ago> in theory they should last a lot longer than HDD or even SSD. The etched plastic yes, but I think the reflective layer of CDs and DVDs is highly sensitive to humidity, shortening the lifespan to 10-20 years. You could probably recover it professionally, but not cheaply.
- krasin 3y ago>the reflective layer of CDs and DVDs is highly sensitive to humidity, shortening the lifespan to 10-20 years. this is actually solved for HTL BD-R Blurays as they use inorganic material for storing data. Only the outer plastic is organic there. See https://en.wikipedia.org/wiki/Blu-ray_Disc_recordable https://en.wikipedia.org/wiki/Blu-ray_Disc_recordable
- 3y ago
- codemac 3y agoHAMR has some serious faults with it's io heads (could rant about this forever), especially given the "reman" logic they use to qualify the durability of the drives. I'd wait until these actually ship, and we get some data on them. These end up basically being flaky new-age tape systems rather than HDD given SMR is required for this density.
- codemac 3y agoOk, I'll rant now. Tape drives have multiple heads for IO, which allows some to fail along the way and you can still read/write your data. This sounds good - but it actually just means these tape drive heads are flaky. What do you do when too many fail? You call IBM or whoever and get them to replace your tape drive, or "reman" it by replacing the failed heads. This is the only way they actually achieve their warranties around lifetime read/writes.. they assume you'll fix the hardware along the way. These HAMR drives have the same problem. The "heat assisted" just means they're using a laser to heat up a piece of gold, and sometimes this means the gold kinda drips around, and the head can be ruined. So their read/write lifetime numbers are pretty loose compared to PMR, and there is an assumption you'll "reman" these drives if they start to have failed heads for IO. However, the gold can even drip onto the platter, giving you permanent data loss anyways. Lastly, they use SMR to get this density. SMR is not like PMR. PMR is what you think of with an HDD with many small blocks either 512B or 4KiB which you can read/write to. SMR has 256MiB (or 128) "zones" that you can only append, or reset. This means instead of being able to write randomly across the drive's capacity, you need to plan out your writes across appendable regions. This complicates your GC, compaction, and reduces your total system IO. Your random read performance is still better than Tape, but this basically turns your HDD solutions into something that looks a lot more like Tape. This is incredibly unpopular technology for this reason. The market for these things is much smaller than most HDD vendors would like. You have a few hyperscalars that have figured out how to write out backups efficiently, but they want a lot of read IO, and reducing the spindle to byte ratio means you have less total system bandwidth to your data. This means that the price per byte would actually need to be lower than their PMR drives, let alone wildly better warranty agreements, for these to be better TCO than current generation drives.
- 3y ago
- iamgopal 3y agoIf we go by surface area / storage, how many atoms per bit this is ?
- runlevel1 3y agoSeeing as how 3D NAND is already using quantum tunneling for charge trap flash, it's gotta be hard to beat that, right?[^1] [1]: https://www.youtube.com/watch?v=5f2xOxRGKqk https://www.youtube.com/watch?v=5f2xOxRGKqk
- dtgriscom 3y agoIt's (probably?) perpendicular recording, so it's depth as well.
- makapuf 3y agoGet perpendicular ! https://m.youtube.com/watch?v=EIzS8XV3Ol4 https://m.youtube.com/watch?v=EIzS8XV3Ol4
- civilitty 3y agoFinally, something dense enough to fit my entire porn collection in a single 2U server!
- at_a_remove 3y agoThinking "quantity has a quality all its own," I've started to wonder more about the black swans on the horizon, should you look far enough: cosmic rays bitflipping your memory, unusual collisions, ridiculous rebuild times, the LTO-machine syndicate ... Maybe file fixity is in the future, where the concept is more foreground than before.
- Shorel 3y agoFinally!? I have a 5 TB external drive I bought many years ago, and despite its big physical footprint, the new drives still don't feel like a justifiable upgrade, given their elevated price for a small increment in storage.
- Culonavirus 3y ago0.04 x 0.59 x 0.43 inches - 1TB MicroSD (with 160/90 MB/s read/write speeds) for $110... now THAT was a shock when I was buying a new phone after several years and I was looking at expanding its storage. It's so surreal to hold such a tiny thing that can store so much data.
- alwayslikethis 3y agoIt's rather unreliable storage though. Don't use those for anything important and always back stuff up from your cameras or similar frequently. SD cards are easily corrupted and lack the mitigation mechanisms things like SSDs have.
- nottorp 3y agoHmm I could use a reminder of what those acronyms say. SMR is the one unusable for desktop stuff because of the sloooow writes? What is HAMR?
- Terretta 3y agoThe one you want at home right now is CMR, or Conventional Magnetic Recording. S is Shingled, H is Heat Assisted, while the article mentions P for Perpendicular which became conventional after nobody has room for L or Longitudinal. Explainer: https://www.linuxadictos.com/en/diferencias-entre-smr-cmr-pmr.html https://www.linuxadictos.com/en/diferencias-entre-smr-cmr-pm... WD NAS apology tour: https://blog.westerndigital.com/wd-red-nas-drives/ https://blog.westerndigital.com/wd-red-nas-drives/ Seagate's CMR/SMR list: https://www.seagate.com/products/cmr-smr-list/ https://www.seagate.com/products/cmr-smr-list/
- barbariangrunge 3y agoJust here to complain about the stingy 256gb ssds in MacBooks
- gnicholas 3y agoThe 256s are also slower than the 512s, IIRC.