5 ms·
Perhaps "true hybrid" == RAM->SSD->HDD->tape, that is, warm-through-cold storage? Whatever. What would be really nice is raw SSD/storage access so that ZFS (o
by cryptonector 9y ago
Perhaps "true hybrid" == RAM->SSD->HDD->tape, that is, warm-through-cold storage?
Whatever.
What would be really nice is raw SSD/storage access so that ZFS (or other FS) could manage all the wear leveling and bad block mappings.
- nomel 9y agoWear leveling is a implementation detail of the medium that can and will change. It doesn't seem right to put that in the filesystem itself. If anything, I would think it should go into some 'generic <specific flash technology here>' device driver.
- tw04 9y ago>. It doesn't seem right to put that in the filesystem itself It absolutely belongs in the filesystem. When you're doing RAID of any type across the devices, you need that layer to manage the underlying media. A single device view will never appropriately manage wear leveling and garbage collection. There's a reason companies like NetApp have been working with drive vendors to have more control over the underlying media: http://www.samsung.com/us/labs/pdfs/2016-08-fms-multi-stream-v4.pdf http://www.samsung.com/us/labs/pdfs/2016-08-fms-multi-stream...
- hvidgaard 9y agoIt's difficult problem to solve. If we do put it in the filesystem, we need some way for the filesystem to know how the NAND behaves. Otherwise the lowest common denominator dictates and nobody gain anything. With this in mind, I don't see why the disk cannot handle this in the firmware. As long as there is enough free NAND on the drive, it can manage wear level and GC just fine assuming that it gets TRIM commands.
- tw04 9y agoYou've just described why we have storage appliances for high performance and enterprise workloads, and why the drive to standardize always swings back around to customized software and hardware.
- cryptonector 9y agoIt belongs in the filesystem in exactly the same way that volume management belongs in the filesystem. ZFS includes volume management, _naturally_. I say naturally, but that was a radical idea 15 years ago. Even now it's not universally accepted, but it's quite correct!
- drvdevd 9y agoI'll add that ZFS is also quite concerned with write patterns IIRC, and thus wear leveling. The author of the article seems to assume we should all be trusting SSD or "hybrid storage" firmware to properly handle this sort of thing for us like nice black boxes. I think this was one of the major problems ZFS was designed to solve. To make storage hardware more simple the idea was to move a lot of this logic into the OS (especially as large RAM sizes got cheaper). It's why having a RAID controller sitting under your vdevs is advised against.
- floatboth 9y agoWhatever is exactly my reaction :) You get raw NAND access on like, home routers. OpenWrt/LEDE uses JFFS2 on that.
- joshka 9y agoChange Tape to Cloud and I think you're on to something.