4 ms·
Doesn't ZFS dedup eat lots of ram? btrfs offers on-demand deduplication instead of it being always-on.
by the8472 10y ago
Doesn't ZFS dedup eat lots of ram? btrfs offers on-demand deduplication instead of it being always-on.
- snuxoll 10y agoYes, it does. But dedup is rarely that useful in my experience, it sounds nice on paper but it often doesn't provide benefits worth the CPU and IOPS demand it generates. Compression is "good enough" 98% of the time, and ZFS does a fine job with it.
- the8472 10y agodedup is quite useful when you have snapshots that somehow have lost their space-sharing. I guess it's due to files being replaced with identical files.
- unhammer 10y agoIf you take snapshotted backups from ext4 etc filsystems (no send/recv), where users regularly reorganise photo folders, dedup is invaluable :-)
- pmarreck 10y agoIf you need filesystem dedup... Perhaps handle it in userspace instead
- the8472 10y agoSince ZoL does not have reflink copies or the range-dedup ioctl you cannot do it from userspace like you can with btrfs.
- rleigh 10y agoThe Btrfs deduplication... also needs vast quantities of RAM. That's just the nature of the beast. Don't use it, and both systems have relatively modest requirements.
- the8472 10y agobut it's on-demand and can use a scratch file, which makes it far more managable, e.g. you can let it run over the weekend.