3 ms·
I don’t understand the goal here. Splitting a file into chunks, hashing them in parallel, and then hashing the resulting hashes is certainly a valid method but
by BobbyTables2 11mo ago
I don’t understand the goal here.
Splitting a file into chunks, hashing them in parallel, and then hashing the resulting hashes is certainly a valid method but not the same as hashing a file the traditional way.
Unless the world changes how they publish hashes of files available for download, I don’t see the point.
- I_like_tomato 11mo agoThe reasoning here is to improve getting hash of a large file (let say size > 100GB). Reading the file content sequently and hashing it will take a lot longer
- BobbyTables2 11mo agoI agree, but there is no way to compute the equivalent of the sequential hash using any parallel method. This isn’t like gzip which can be parallelized. Without standardization of a parallelized hash computation, it’s just a toy exercise in an embarrassingly parallel problem.