10 ms·
Western Digital HDD boss mentions archive disk drive idea
- sharmin123 5y agoThings To Consider Before Hiring A Professional Hacker: https://www.hackerslist.co/things-to-consider-before-hiring-a-professional-hacker/ https://www.hackerslist.co/things-to-consider-before-hiring-...
- throw0101a 5y agoMore interested in a linked article: > Wikibon argues the cross-over timing between SSDs and HDDs can be determined using Wright’s Law. This axiom derives its name from the author of a seminal 1936 paper, entitled ‘Factors Affecting the Costs of Airplanes, in which Theodore Wright, an American aeronautical engineer, noted that airplane production costs decreased at a constant 10 to 15 per cent rate for every doubling of production numbers. His insight is also called the Experience Curve because manufacturing shops learn through experience and become more efficient. […] > “Wikibon projects that flash consumer SSDs become cheaper than HDDs on a dollar per terabyte basis by 2026, in only about 5 years (2021),” he writes. “Innovative storage and processor architectures will accelerate the migration from HDD to NAND flash and tape using consumer-grade flash. … * https://blocksandfiles.com/2021/01/25/wikibon-ssds-vs-hard-drives-wrights-law/ https://blocksandfiles.com/2021/01/25/wikibon-ssds-vs-hard-d... Interesting prediction.
- JaimeThompson 5y agoFlash has to be powered so the contents of each cell can be refreshed so data isn't lost which make it a less than optimal solution for long term archival storage or offside backups. Simply storing the physical media is easier than maintaining and keeping secure systems to plug the flash devices into.
- edoceo 5y agoCan you put them in a battery powered box, with no data connection? I'm thinking my little consumer grade APC could power one for many days (months?). I'll have to check the numbers
- wtallis 5y agoYou don't need to keep SSDs powered continuously. You just need to power them on periodically and read all the data on the drive so the SSD controller has the chance to notice data degradation and repair it before it becomes unrecoverable. This does not need to be done more often than once per year. For SSDs that are exclusively used for archival and thus never approach the end of their rated write endurance, it may be adequate to do this once per decade. Basically, any backup strategy that includes a sensible amount of testing and verification should suffice.
- JaimeThompson 5y agoIBM, Samsung, Intel, and other manufactures of flash and flash based products disagree with you on that only once per year time frame. As flash gets more and more dense leakage from the cells becomes a much more difficult problem to solve.
- wtallis 5y agoLast time I checked, those companies were still adhering to the JEDEC standards for how they define SSD write endurance, which is based on how worn-out the flash can be while still meeting certain unpowered data retention thresholds. For consumer SSDs, that threshold is one year unpowered and stored at 30°C. [1] All of the challenges of unpowered data retention are already being addressed in the normal course of bringing new generations of flash and SSDs to market, even though nobody is yet making drives specifically tailored for that use case. Additionally, lightly-used flash has error rates that are orders of magnitude smaller than flash that has reached or is approaching its write endurance limit. Which is why an archive-only SSD can very reasonably be expected to provide unpowered data retention far in excess of one year. [1] For enterprise drives, the specified duration is shorter but the storage temperature is higher. The warrantied write endurance is also typically higher, so those drives are willing to take their flash to a more thoroughly worn-out state.
- throw0101a 5y ago> Flash has to be powered so the contents of each cell can be refreshed so data isn't lost That's not how flash storage works. You can unplug a flash drive and put it on a shelf and it will keep its data. Here's a review of portable, external SSDs that don't lose their data when not plugged in: * https://www.tomshardware.com/reviews/best-external-hard-drive-ssd,5987.html https://www.tomshardware.com/reviews/best-external-hard-driv... Are you thinking of DRAM perhaps?
- nisegami 5y agoNo, they're referring to bit rot on flash storage due to slow leakage of the charge that represents the data. It occurs on long time scales, definitely years. But the more bits per cell (SLC vs TLC vs QLC), the more likely it is.
- deleted 5y ago[deleted]
- throw0101a 5y ago> No, they're referring to bit rot on flash storage due to slow leakage of the charge that represents the data. Could not the same be said of the magnetism of the bits on spinning rust? What's the shelf life of data on an HDD? Tapes also have magnetic charge, but are designed to be "unrefreshed" for longer periods of time.
- labawi 5y agoTapes and HDDs are magnetic. Flash and DRAM is electric. It is easier to create magnetically stable structures (magnets) than non-leaking capacitors. Flash has a better insulator than DRAM, but it wears out with use and leaks more with higher temperature, densities, less margin with more bits per cell...
- JaimeThompson 5y agoDepending on the design of the flash, the storage temperature, and other factors that data can rot. Please see [1] for one source. [1] https://www.ibm.com/support/pages/flash-data-retention-0 https://www.ibm.com/support/pages/flash-data-retention-0
- selfhoster11 5y agoThat's what I'm thinking. If flash-based archives require servicing to keep their data, there are systems that provide far better trade-offs for similar amount of bother.
- deleted 5y ago[deleted]
- ksec 5y agoLOL this remind me of Anandtech comments ( and majority of internet comments )in 2015 / 2016, "HDD will be dead by 2020". They were still repeating the same thing in 2018 / 2019. And we are now closing to 2022, and it is far from dead if not growing. ( I still dont understand why most people cant read roadmaps ) WD develops both NAND ( via SanDisk / Toshiba ) and HDD. They know the roadmap of both HDD and NAND. There is nothing on the current NAND roadmap which suggest we get another significant cost reduction. As much as I want to see 2TB SSD below $99. I would be surprised if we could even get to that point by 2024. Today a portable 5TB HDD cost $129, ( or $109 with discount ) This is similar to DRAM, we might get faster, higher efficiency DRAM. But we are not getting any cheaper DRAM. The price of DRAM / GB in the past 10 years has had the same price floor. HDD is in similar case, it is near the end of the S curve.
- wheybags 5y agoThe article is interesting, but it reads like it was dictated to a speech-to-text system.
- abricot 5y ago"right once read never"
- h2odragon 5y agoOnce the latency requirement goes past ... i dunno, a few seconds? "Insh'allah" time frames; tape comes in and stomps all over the competition with its space / cost tradeoff. Dismountable media and a mechanism to swap tapes (even a meatsicle if need be) just has too many advantages to compete with. Gets me thinking tho: Why stop at 5.25in drives? Let's go back to washing machine sized units or even bigger. Let's stack platters so dense and heavy that we can use the spindle as a flywheel UPS system too. Or how about making a truly gigantic tape spool? Perhaps kevlar threads impregnated with iron could serve as "tape" and we could spin kilometers of that onto a spool.
- bluedino 5y agoQuantum's marketing for their BigFoot 5.25" drives was interesting. They argued that a 3600 RPM drive was as fast as 5400 RPM 3.5" drive because you're spinning a larger diameter platter. Technically true. They also claimed that since you could fit more data on a track, since it was larger, you would do less seeking, and that's what makes mechanical hard drives slow. This didn't stop BigFoot drives from being slower than 3.5" drives that were 3 years older and 1/4 of the capacity.
- h2odragon 5y agoI loved my bigfoot drives. Yes they were slow, but they was cheap and ran cool and (excepting certain lines) proved amazingly durable. As in, "ran as the mail spool disk for a decade" for a system sending ~5k emails a day. That one i think i still have on a shelf here somewhere with a "well done thou faithful servant" postit note
- rwmj 5y agoIntuitively this sounds wrong because hard drives can only scale the area of magnetic surface to fixed overhead by a certain amount -- literally you can't fit more than a certain number of platters into a 3.5 or 5.25" case. Whereas tape can scale that number far more just by using larger reels and/or a tape library.
- selfhoster11 5y agoWhat's wrong with double or triple-height drives?
- rwmj 5y agoThey don't fit in existing bays. But even if we define a new standard of (say) a hundred 12" platters in 12" high cases, the fixed infrastructure (r/w heads, arms, case, board) does not scale as well as tape.
- selfhoster11 5y agoCouldn't multi-actuator drives alleviate the issue?
- rwmj 5y agohttps://blog.seagate.com/craftsman-ship/multi-actuator-technology-a-new-performance-breakthrough/ https://blog.seagate.com/craftsman-ship/multi-actuator-techn... Looks like interesting technology but I don't see how that helps here.
- wtallis 5y agoMulti-actuator drives would be moving in exactly the wrong direction for reducing those costs. A dual-actuator drive is essentially two drives sharing the same spindle—and the same case height, thereby cutting the number of platters per actuator in half.
- deleted 5y ago[deleted]
- boilerupnc 5y agoI find DNA storage plays really interesting. Will be fascinating to see what Microsoft[1], Iridia [0], etc ... solutions evolve into. "two major problems of traditional storage devices: data density and durability. One of the densest forms of storage is tape cartridges, which house about 10GB/cm3. Iridia is on a path to having a storage device that could store 1PB/cm3 and reduce latency by 10–100 times compared to magnetic tapes. The other problem that Iridia is solving is durability. Rotating disks tend to work for 3–5 years, while magnetic tapes for 8–10 years. Because DNA is extremely durable, Iridia’s technology on the other hand has an estimated half-life of more than 500 years." [0] https://outline.com/a97xFX https://outline.com/a97xFX [1] https://www.microsoft.com/en-us/research/project/dna-storage/ https://www.microsoft.com/en-us/research/project/dna-storage...
- howdydoo 5y agoInteresting. I wonder how fast you could theoretically read/write data stored in DNA. I could imagine it being used in place of tape storage, maybe, but it seems like it would be extremely fragile if you try to read through it at hard drive-speed. EDIT: according to some random website, the human genome contains 3.2GB, and it takes a cell 24 hours to divide. That works out to 37KB/s, which is not very promising.
- KingMachiavelli 5y agoIf the performance difference significantly price per terabyte then I would certainly use these. As long as the actual sequential throughput isn't terrible they should be fine for media storage. That said Windows and Linux could certainly get some polish when it comes to accessing high latency storage. Opening a high-latency or even missing network share on Windows (still?) causes explorer.exe to hang. Linux might handle multi-second IO OK but I have had cases on extremely bad flash USB drives (hacked a bunch of write-once drives) where the IO is blocked for minutes after the write appears to have finished. In any case it would be really could to throw bcachefs on a HDD drive like this with a cache SSD.
- wongarsu 5y ago> Opening a high-latency or even missing network share on Windows (still?) causes explorer.exe to hang It's not like Windows doesn't have good APIs that allow you to do better. explorer.exe (or at least the file explorer part) is just an objectively bad product. It wasn't that long ago that it didn't allow you to create files starting with a dot, despite that being an entirely legal path name. And it still doesn't support long paths or alternate data streams, making it pretty easy for software to create files that you can't view in explorer. I'm kind of surprised that it doesn't seem to have any popular alternatives, considering how consistently bad it is (outside of small subsets, like compression or file copying)
- olyjohn 5y agoThere used to be different windows "shells" that you could install and replace Explorer with. I would guess that these are "critical system files" now and Windows would not let you replace them like you could back in the day. Probably "security something blah blah..."
- lloydatkinson 5y agoI believe you still can yes
- cryptonector 5y ago
- MisterTea 5y agoI understand that this is enterprise storage related but can we just get cheap optical storage back? My DVD drive can read CD's from the early 90's I used in my 1x CD-ROM drive with caddies in my 486. Those same CD's would also work in a Blu-ray drive. That's true backwards compatibility. I want a 1TB optical drive with ~100MB write speeds which supports incremental writes. I know I'm asking for a lot but if you could give me the ability to buy a 1TB disc for $1 or less I'm all over it. Archival discs that last for 50+ years would be a huge bonus as well. Perfect cold storage solution.
- wongarsu 5y agoI doubt we will get another generation of optical storage after the current Ultra HD Blu Ray. The movie industry doesn't really need more and is moving to streaming anyways, and video game consoles are adequately served by them and are rapidly moving to digital-only. By the time storage requirements in either industry move beyond what Ultra HD Blu Ray can support they won't be selling disks anymore. And without a major consumer industry driving demand there's little hope of reaching an attractive price point.
- pradn 5y agoBlu-Rays have become specialty items, like vinyl. Even most big-budget movies don't seem to have 4k Blu-Rays, let alone smaller movies. And there's now more and more direct-to-streaming movies that will never get a physical media release; think Netflix.
- ThatMedicIsASpy 5y agoAnd this prevents it being available in good quality. Streaming is not good quality.
- pradn 5y agoI'm totally with you. I like buying Blu-Rays for especially beautiful films.
- pmlnr 5y agoI'm still waiting for that 360TB 5D Optical Data Storage ( https://en.wikipedia.org/wiki/5D_optical_data_storage https://en.wikipedia.org/wiki/5D_optical_data_storage ) promised many years ago, albeit not by WD.
- ahupp 5y agoI wonder if it's feasible to make many sets of platters share a single set of heads? Similar to tape, but once the heads are mounted to a specific set of platters you get disk-like latency. Keeping the environment inside the drive clean (or filled with helium) seems like the challenge.
- mikewarot 5y agoLoading/unloading the heads when moving to the next platter would be the dangerous/slow part. It's easier to keep all the heads flying, and move them in parallel.
- MayeulC 5y agoI wonder if a "minidisc"-like format if feasible, where you would insert a protected platter inside of a harddisk? I'd be willing to use that over huge HDDs. Give me 1TB platters at 5-15€/platter (consumer HDDs come close to €18/TB for large capacity). Actually, I wouldn't mind having them more expensive than HDDs per TB, as I wouldn't have to pay €250 at a time for bulk capacity upfront.
- nayuki 5y agohttps://en.wikipedia.org/wiki/Jaz_drive https://en.wikipedia.org/wiki/Jaz_drive
- riobard 5y agoOptic disks work that way, but highly unlikely for hard drives as the internal chamber requires super clean air without any dust. Latest hard drives over 8TB mostly have adopted helium-sealed chamber, making removable platters even less feasible.
- selfhoster11 5y agoThey use helium mainly because of data density. If removable platters required less precise heads, you could still use air.
- smarx007 5y agoGorakhpurwalla said: “I think even if you go beyond those tiers, all the way down into very little access, maybe write once read never, you start to get into a medium that still exist as we go forward in paper or other forms, perhaps even optical.” https://devnull-as-a-service.com/ https://devnull-as-a-service.com/ there you go, robust support for the write once read never use case.
- jimis 5y agoNow that SSDs are ubiquitous, hard disk drive manufacturers should up their game: * 5.25'' drive which is taller (more platters) and wider (more sectors per platter) * Slow rotational speed to reduce consumption and vibration * SMR again, but label the products accordingly * Small (64-128GB) SSD embedded, acting as transparent cache especially for quick response to write commands. * Possibility to disable this caching layer with a SATA command.
- cryptonector 5y agoOne of the problems with HDDs for long-term backup is that they need to be spun from time to time else they might not start up when you need them. Or, at least, that's what I remember being told fairly long ago. Maybe that's no longer the case?
- ComputerGuru 5y agoModern disks have read/write heads that don’t magically seize from lack of use any more. SSDs are way worse here: if it’s not powered up (and initialized), the individual NAND cells lose their charge and you’ll fairly quickly get some serious bitrot (especially with TLC and now QLC being the predominant options leaving very little room for analog drift). You can no longer throw an external drive into a safe and leave it there for a couple of years like you could with 2.5” or 3.5” spinning rust.
- Khaine 5y agoAfter all the shenanigans they pulled with SMR disk drives, the only idea I have for the boss of Western Digital, I can't say on hacker news.
- Sitio 5y agoStill waiting for something cheaper than buyingbackup hard drives for 10tb of data. I nearly calculate the cost of using tape every year and it's just not end-user useful :-( The drives are too damn expensive and probably not that nice to use.
- daviddever23box 5y agoWould hyperscalers jump at a 72 TB 5.25” HDD? Maybe-though the larger issue is that de-duplicated, layered large-file storage (e.g., VMs, whole-disk images) still requires warm storage for the base layers. Might be an excellent choice for the Iron Mountains of the world, especially for long-form media storage, though I think that the majority of personal long-term storage is actually shrinking, in terms of growth rate.
- toomuchtodo 5y agoWould be relevant for folks like Backblaze and the Internet Archive, where you write once, read many, but rarely delete. 60 72TB drives gets you 4.3PB per chassis/pod, and assuming 10 pods to a rack, 40PB racks. For comparison, 3 years ago, the Internet Archive had about 50PB of data archived and 120PB of raw disk capacity. https://news.ycombinator.com/item?id=18118556 https://news.ycombinator.com/item?id=18118556
- cameron_b 5y agoAnd as "rarely" approaches zero ( think legal hold-type "you may surely not delete" ) there is a cost-saving in warm-ish storage in terms of replication and maintenance. Ensuring that your Tape archive is good is a pain unless you have huge tape robots - https://www.youtube.com/watch?v=kiNWOhl00Ao https://www.youtube.com/watch?v=kiNWOhl00Ao
- mlyle 5y agoNote he speculated about a 5.25" form factor drive. You're not going to fit 60 of those in something Backblaze-pod sized.
- toomuchtodo 5y agoLooks like 60 5.25" drives from their website? https://www.backblaze.com/blog/open-source-data-storage-server/ https://www.backblaze.com/blog/open-source-data-storage-serv... https://www.backblaze.com/blog/wp-content/uploads/2016/04/blog-60-drives-ooh-aah.jpg https://www.backblaze.com/blog/wp-content/uploads/2016/04/bl... Edit: My mistake! I was confusing 5.25 form factor with 3.5 :/ much shame.