2 ms·
How else could they do it? All systems I've seen that have relied on files on a file system use the file name as the "primary key" I believe you can use journa
by catmanjan 6y ago
How else could they do it? All systems I've seen that have relied on files on a file system use the file name as the "primary key"
I believe you can use journalling to detect file name change events but I don't think it scales well
- pengaru 6y agoWho is "they"? Are you asking about rysnc developers or filesystem developers? For a filesystem the developers are free to innovate on any form of filesystem-wide block checksumming and content-addressed deduplication approach. This kind of global block-level content awareness is entirely decoupled from filenames and paths. Using rsync to underpin a filesystem strikes me as a gross hack done by developers punting on the real challenges of modern filesystem development. WRT rsync doing better than --fuzzy, the options are more limited since it's a userspace tool working within the confines of filesystem APIs like POSIX.
- catmanjan 6y agoSo basically there is no good solution at the moment, and a good solution would probably involve enhancing the underlying filesystem - this was the same conclusion I came to
- ComodoHacker 6y agoFor example, zpaq splits files in chunks and hashes them, so it can deduplicate across files.