4 ms·
If you don’t mind CLI tools, You can try dedup - https://github.com/ttkb-oss/dedup https://github.com/ttkb-oss/dedup . Use the —-dry-run option to get a list of
by jonhohle 2y ago
If you don’t mind CLI tools, You can try dedup - https://github.com/ttkb-oss/dedup https://github.com/ttkb-oss/dedup . Use the —-dry-run option to get a list of files that would be merged without modifying anything and how much space would be saved.
- Take8435 2y agoI'll check it out! Thanks!
- bmn__ 2y agoOn good file systems (see <https://news.ycombinator.com/item?id=43174685 https://news.ycombinator.com/item?id=43174685>) also identical chunks of files can be merged, resulting in more savings than with just whole files. As of now, dedup cannot help with this, but duperemove or jdupes do.
- jonhohle 2y agoYeah, not having an extent API or even an API that can clone to a file descriptor is unfortunate. That said, keeping track of blocks and extents for deduplication would be a much more expensive problem to solve.