3 ms·
I just can’t see this. HDDs hit a Pareto frontier in their niche not matched by tapes (slower access times, no real random access so expensive to fetch) and SSD
by vlovich123 4y ago
I just can’t see this. HDDs hit a Pareto frontier in their niche not matched by tapes (slower access times, no real random access so expensive to fetch) and SSD (it will retain $/gb for the foreseeable future). Maybe electricity costs are significant but if you’re a hyperscaler storing exabytes, what else are you going to use to store the vast majority of infrequently accessed content?
Am I missing something?
- wtallis 4y agoFitting in between two other technologies on the Pareto frontier doesn't guarantee the niche will stay wide enough to be economically viable. Optane failed because it couldn't carve out enough of a market in between flash and DRAM. But I don't expect hard drives to die out entirely within the foreseeable future. Their niche will get smaller, but they're able to steal some market share from tape and can sacrifice performance to save power, while probably staying cheaper on an up-front $/TB basis than flash.
- vlovich123 4y agoTLDR: I think electricity costs of HDDs will come down rather than HDDs go away because the gap between flash and tape is so large on both performance and $/gb. Optane is a different story. I can see drives switching to 5400RPM or even more complex stuff being developed like variable rate (like write out at one rate RPM but only go up to 15k RPM for reads when there’s sufficient traffic and park when idle) to conserve energy. Additionally, by looking at what data is cold and “defragging” in a distributed fashion, you could arrange for entire host machines attached to the disks to shut down. I would imagine that the electricity hog is the machine itself rather than HDDs idling with their heads parked and thus you’d see more savings that way. Re Optane I agree not all Pareto frontier niches survive just because they exist but Optane is different here because it’s not a strict Pareto frontier. It’s more expensive, used more electricity, and has less capacity than SSDs. The introduction of NVMe made flash performance competitive enough with Optane that there wasn’t much to maneuver (https://ssd.userbenchmark.com/Compare/Samsung-980-Pro-NVMe-PCIe-M2-2TB-vs-Intel-905P-Optane-NVMe-PCIe-960GB/m1454302vsm498903 https://ssd.userbenchmark.com/Compare/Samsung-980-Pro-NVMe-P... - granted 3 year gap but I think Intel wasn’t necessarily able to sustain continued performance improvements and could only really improve $/GB). Intel also failed to invest SW to take advantage of its byte addressability by reducing RAM usage through XIP although not sure how big of a difference that would end up being.
- kibwen 4y agoCan we step back and appreciate both how impressive and how bizarre it is that, in the year 2023, tape media is still somehow the cheapest per byte?
- eimrine 4y agoNothing impressive for me, tape has the longest ping (especially in the worst-case scenario) and the least number of interactions (I mean it can not survive just one million reads).
- hammyhavoc 4y agoIt's usage scenario is completely different though. Generally, LTO is best-suited for backups and appending changes to the tape rather than reading it back. It's the backup method you hope you never need to use, but you'll be glad it's there if the shit hits the fan that badly.
- eimrine 4y agoI have a prediction/belief that in Blockchain era a lot of people are going to use those huge LTO for the sake of mining which is going to be something as important to us as smartphones in 2023.