3 ms·
> ZFS has its own de duplicator built in, which is nice. It should just deduplicate files and individual extents of files by itself once you enable it. Probably
by yjftsjthsd-h 3y ago
> ZFS has its own de duplicator built in, which is nice. It should just deduplicate files and individual extents of files by itself once you enable it. Probably not a good idea on very write-heavy disks, but it's an option.
It's also a memory hog, and I feel like there were other caveats but I don't remember for sure
- buildbot 3y agoHuge memory impact, that never goes away - if you turn of dedup, you still need the massive deduplication map in ram for things that already where deduplicated.
- JackSlateur 3y agoActually, you can, if you do offline deduplication, because memory can be replaced by storage
- buildbot 3y agoInteresting! I did not know that.
- keep_reading 3y agoYou can now dedicate an SSD or something fast to holding the deduplication tables so it's not a memory hog anymore
- DannyBee 3y agoI sent a pull request to zfs that adds support for fiduperange, which makes all these tools work without having to turn on the large scale online deduplication. Instead it uses block cloning. Test it if you are willing!