3 ms·
LZMA is better than gzip i think. Also secrets deserves to stay in the library, Python has hashlib and it should have a secure RNG by default. glob too (or Pa
by jimbo1qaz 7y ago
LZMA is better than gzip i think.
Also secrets deserves to stay in the library, Python has hashlib and it should have a secure RNG by default.
glob too (or Path.glob).
And I've used shlex for command-line-escape parsing (it might not have been the optimal solution?)
- masklinn 7y ago> LZMA is better than gzip i think. LZMA provides much better compression at much higher costs. Generally speaking it's pretty strictly better than bzip2, not necessarily gzip (DEFLATE, really). In my experience, zstd can be considered better than gzip/deflate (almost every time I tried it, it provided as-good-or-better compression at much faster throughput).
- maxnoe 7y agoYes, zstandard turned out to be the best option in all our tests on small to really large data (couple of mb to gigabytes filesize). A few percent better compression than gzip and nearly 50 % faster decompression. Gzip is pretty slow in the python standard lib. The python zstandard bindings unfortunately do not allow back seeking.