4 ms·
Why doesn't parallelized gzip get more attention? For larger files, it can be quite a pain to see a multicore machine sit mostly idle. Something like this works
by bpchaps 10y ago
Why doesn't parallelized gzip get more attention? For larger files, it can be quite a pain to see a multicore machine sit mostly idle. Something like this works pretty well, but I've never seen it done outside of my own stuffs:
split -l1000000 --filter='gzip > $FILE.gz' <(zcat large_fille.txt.gz)