4 ms·
Or you could use a base filesystem that supports compression, such as ZFS. shrug
by Filligree 10y ago
Or you could use a base filesystem that supports compression, such as ZFS. shrug
- polygot 10y agoBut if you just want one directory on an existing filesystem to be compressed, this might be an easier option
- givemefive 10y agoOn top of each vdev (tank) you can make datasets (tank/logs) and mount those wherever Each of these datasets can have their own options set. So yeah it's basically the same thing as btrfs?
- funkaster 10y agoYou could specify a dataset that mounts to a specific (sub)directory. Or even have a file-backed pool just like the example.
- barrkel 10y agoThe article's suggestion means eating up 50G of allocation straight away. I don't think needing to estimate your compressed allocation up front is an easier solution at all. Normally with directories you use thin provisioning pulling from the whole device's free space; thick provisioning for a directory is not a path for easier reduce space consumption.
- nisa 10y agoyou could also do the trick with zfs - just create an zpool on that loop device - this also gives you lz4 and gzip
- shmerl 10y agoYes, but ZFS is probably more memory hungry and somewhat an overkill just for compression alone. It's a pity simpler filesystems don't have transparent compression.
- matt_wulfeck 10y agoI'm not sure it's an overkill compared to the presented solution.
- keeperofdakeys 10y agoOne disadvantage of zfs in this case is that it uses its own caching layer, since it's basically an OS subsystem in itself. So on a memory constrained host (eg. rpi), you might have some issues with the zfs and linux buffers competing for RAM.
- trentnelson 10y agoLike NTFS has had for the last 20+ years? ;-) One of the benefits of NT's packet-driven I/O model (versus the UNIX synchronous VFS read/write blocking buffer I/O model).
- shmerl 10y agoBTRFS is now good for it, but having it in other filesystems would be useful too. Linux now supports some async I/O as well.
- flukus 10y agoWhat does the calculation for file system compression look like these days? On one hand we've got faster SSDs, but on the other we've got more spare cores and SSD space is relatively expensive compared to HDD space.
- hultner 10y agoWith LZ4 overhead is rather low, generally you'd get higher end to end throughput with LZ4 enabled. It's not as space efficient as more expensive algorithms but great for high performance scenarios.