3 ms·
are there any systems that do sha-1 for dedup? I am only aware of sha-256.
by MichaelMoser123 7y ago
are there any systems that do sha-1 for dedup? I am only aware of sha-256.
- deleted 7y ago[deleted]
- munificent 7y agoGit?
- deleted 7y ago[deleted]
- MichaelMoser123 7y agogit computes the sha1 checksum over the header that includes the length + the file data; also checks the length in the header as well as the the hash; Linus says that it would be less practical to find a collision that has the same length as the original data; I guess at some stage even that might become possible.
- fanf2 7y agoSubversion's dedup was broken by the http://shattered.io/ http://shattered.io/ SHA-1 collision in 2017 https://medium.com/@hyrum/shattered-subversion-7edea4ba289c https://medium.com/@hyrum/shattered-subversion-7edea4ba289c
- rakoo 7y agobup does. Even worse: rsync relies on md5 for finding duplicate blocks.
- MichaelMoser123 7y agoat least rsync does that only when --checksum is specified as option; otherwise it assumes that files with the same date/time/size are the same (which is probably not too bad as a default).