2 ms·
You quoted the wrong bit, if you're looking for his argument against hashing. The strong argument is in the section labeled: > Checksumming every input file be
by NateEag 6y ago
You quoted the wrong bit, if you're looking for his argument against hashing. The strong argument is in the section labeled:
> Checksumming every input file before building is very slow
- tyingq 6y agoI'd be interested in comparing a fast CRC checksum versus their approach of stat() plus pulling a sequence number. I'm sure it's slower, but I'm curious how much slower for tens of thousands of files.
- jeffbee 6y agoFar and away the fastest CRC on my local box is Adler's checksum that uses the Intel hardware CRC32 instruction (introduced a long time ago, almost universally supported at this date). It only needs 40ms CPU time per GB, about 50x faster than md5sum. If you have a very new CPU you might have hardware SHA support.