3 ms·
While regular dedup is only a win for highly specific workload, the file-based deduplication[1][2] which is in the works seems like it can have some potential.
by magicalhippo 5y ago
While regular dedup is only a win for highly specific workload, the file-based deduplication[1][2] which is in the works seems like it can have some potential.
They discussed it, along with some options for a background-scanning dedup service (trying to find potential files to dedup), in the February leadership meeting[3].
[1]: https://openzfs.org/wiki/OpenZFS_Developer_Summit_2020_talks#File_Cloning_with_Block_Reference_Table_.28Pawel_Dawidek.29 https://openzfs.org/wiki/OpenZFS_Developer_Summit_2020_talks...
[2]: https://youtu.be/hYBgoaQC-vo https://youtu.be/hYBgoaQC-vo
[3]: https://www.youtube.com/watch?v=hij7PGGjevc https://www.youtube.com/watch?v=hij7PGGjevc
- oofbey 5y agoThis sounds cool. Current block dedup really seems like a simple (naive) v1 compared to what should be possible.