4 ms·
This is a low-effort post, showing basic CLI usage and nothing else. Pigz does not actually decompress in parallel, as the author implies, underscoring the impo
by goodside 6y ago
This is a low-effort post, showing basic CLI usage and nothing else. Pigz does not actually decompress in parallel, as the author implies, underscoring the importance of benchmarking things — especially when you're only considering them for performance reasons. See: https://github.com/madler/pigz/issues/36 https://github.com/madler/pigz/issues/36
For compression, pigz is only useful for compressing a single large file in a scenario where you must use gzip. For large collections of files, wrapping normal gzip with GNU Parallel would be faster. In scenarios where you control both compression and decompression, you'd be better off picking a more modern compression algorithm than gzip. ZStandard is almost always the right choice, but this benchmark is a great resource for comparing other options: https://quixdb.github.io/squash-benchmark/ https://quixdb.github.io/squash-benchmark/