3 ms·
I don't think gzip can use multiple cores, but there is a parallel implementation of gzip called pigz (race condition pun?) [1] which uses a clever trick [2] no
by abiogenesis 6y ago
I don't think gzip can use multiple cores, but there is a parallel implementation of gzip called pigz (race condition pun?) [1] which uses a clever trick [2] not to reduce compression efficiency:
> The input blocks, while compressed independently, have the last 32K of the previous block loaded as a preset dictionary to preserve the compression effectiveness of deflating in a single thread
[1] https://zlib.net/pigz/ https://zlib.net/pigz/
[2] https://zlib.net/pigz/pigz.pdf https://zlib.net/pigz/pigz.pdf