6 ms·
> Essentially, ZFS manages my files for me. Yes! Managing our files is the whole point of file systems! It's amazing how bad at it most of them are. Linux is s
by matheusmoreira 6y ago
> Essentially, ZFS manages my files for me.
Yes! Managing our files is the whole point of file systems! It's amazing how bad at it most of them are. Linux is still catching up with btrfs...
It's extremely aggravating how most file systems can't create a pool of storage out of many drives. We end up having to manually keep track of which drives have which sets of files, something that the file system itself should be doing. Expanding storage capacity quickly results in a mess of many drives with many file systems...
Unlike traditional RAID and ZFS, btrfs allows adding arbitrary drives of any make, model and capacity to the pool and it's awesome... But there's still no proper RAID 5/6 style parity support.
- earthscienceman 6y agoIt really is incredible. ZFS datasets are essentially data collections, and I can categorize my files according to how I want them managed. It's essentially what iOS dreams of but in a much more manageable, configurable, and open way.
- sly010 6y agoOne beef: Moving files between datasets are an unnecessarily expensive operation.
- seized 6y agoMainly because the dataset is the ZFS version of a partition. In one pool, each dataset can have its own record size, compression settings (on/off or different levels, even different algorithms), be encrypted, have deduplication turned on... Its impossible for it to not be an "expensive operation".
- cm2187 6y agoAnd the windows equivalent is Windows Storage Space which sucks hard for parity volumes (max write speed 60MB/s whereas the same set of drives in any other software RAID writes close to 1GB/s). I would have thought this was a long solved problem. Kind of like chat applications.
- TillE 6y agoIt doesn't help that Microsoft has completely abandoned ReFS. Maybe there were good technical reasons why it was a dead-end, I dunno, but it's really no fun being stuck with NTFS.
- bityard 6y ago> It's extremely aggravating how most file systems can't create a pool of storage out of many drives. Some would argue that is the job of the volume manager, not the filesystem. On Linux it's LVM2, FreeBSD has vinum, for example.
- matheusmoreira 6y agoI would argue that a volume manager is just one of many parts of a good file system. Managing physical devices at the file system level has advantages: the file system can balance its data automatically in the background. Linux LVM can't do that.
- geerlingguy 6y agoI think this gets into the more philosophical part of the debate like with systemd, where it seems like it could be argued that the separation is better—or not—depending on your needs. And for my own needs, I typically favor the security of not throwing too much complexity on top of my storage system (if it would be impossible for me to recover something without relying on a ton of magic I can't fully understand, I'd rather not use it in production).
- throw0101a 6y ago> Some would argue that is the job of the volume manager, not the filesystem. ZFS is both at the same time. That is why there is the zpool command and the zfs command. While tight-coupling is sometimes bad, in this instance it is useful: * https://web.archive.org/web/20070508214221/http://blogs.sun.com/bonwick/entry/rampant_layering_violation https://web.archive.org/web/20070508214221/http://blogs.sun....
- AsyncAwait 6y ago> Linux is still catching up with btrfs... ZFS is available on Linux if you want it, in fact FreeBSD is basing its support for ZFS on it. For a mainline option, am personally holding out hope for bcachefs, rather than btrfs.
- RMPR 6y agoIt seems like btrfs will gain a lot of traction, considering that Facebook invest a lot in it and it's the default FS in Fedora now.
- AsyncAwait 6y agoMaybe. But I wonder if btrfs has been tainted as 'too unreliable' at this point, whether true or not.
- throw0101a 6y agoI first heard about Btrfs over ten years ago: what's taking it so long to 'gain traction'?
- IgorPartola 6y agoMy guess is bugs. Early on they had some serious bugs that lost people data. So the project gained this reputation of not being production-ready which meant that only people interested in playing with a new filesystem were using it. And btrfs has always been brought up alongside zfs which has been stable and mature for decades. As far as I can tell the only advantage btrfs has over zfs is the license. Outside of that, what does it offer that zfs does not? (That’s a serious question, I haven’t kept up with it because I’m a happy zfs user.)
- Lex-2008 6y ago> what does btrfs offer that zfs does not? As @matheusmoreira mentioned - you can use harddisks of unequal size. I.e. three disks of 4+3+3 Tb in RAID1 will happily give you 5 Tb of usable space. AFAIK, no other filesystem can do that. Quoting @matheusmoreira further: > I can slowly buy drives of different capacities and add them to the file system one by one. I don't have to plan ahead of time like traditional RAID and ZFS setups. This is excellent for home data storage!