2 ms·
I'd be interested in comparing a fast CRC checksum versus their approach of stat() plus pulling a sequence number. I'm sure it's slower, but I'm curious how muc
by tyingq 6y ago
I'd be interested in comparing a fast CRC checksum versus their approach of stat() plus pulling a sequence number. I'm sure it's slower, but I'm curious how much slower for tens of thousands of files.
- jeffbee 6y agoFar and away the fastest CRC on my local box is Adler's checksum that uses the Intel hardware CRC32 instruction (introduced a long time ago, almost universally supported at this date). It only needs 40ms CPU time per GB, about 50x faster than md5sum. If you have a very new CPU you might have hardware SHA support.