3 ms·
Then just compress every 10MB or whatever independently. Probably a good idea for parallelism anyway.
by IshKebab 4y ago
Then just compress every 10MB or whatever independently. Probably a good idea for parallelism anyway.
- masklinn 4y agoWhat are you talking about?
- IshKebab 4y agoYou two were debating the benefits of `tar.gz` style solid compression vs zip style independent compression of files. Zip allows random access while solid compression will give slightly better compression for small similar files. I was pointing out that you can have the best of both worlds by catting all the files together like `tar` but then compressing it in chunks instead of as one big stream. Plus compressing it in chunks allows you to decompress it in parallel.