3 ms·
zstd is faster and smaller. If you can choose the format, zstd beats deflate across the board, on every front except for compatibility with things that only und
by JoshTriplett 6y ago
zstd is faster and smaller. If you can choose the format, zstd beats deflate across the board, on every front except for compatibility with things that only understand deflate.
Also, if you need to use deflate for compatibility, use https://github.com/zlib-ng/zlib-ng https://github.com/zlib-ng/zlib-ng , which is substantially faster than either zlib or gzip.
- joseluisq 6y agoYeah, and it is IETF standard since 2018 https://tools.ietf.org/html/rfc8478 https://tools.ietf.org/html/rfc8478
- dependenttypes 6y agoIs it though? In https://quixdb.github.io/squash-benchmark/unstable/ https://quixdb.github.io/squash-benchmark/unstable/ deflate beats zstd at least in some tests.
- joseluisq 6y agoYeah, but zstd beats deflate in others. For example the latest MySQL 8 https://dev.mysql.com/worklog/task/?id=13442 https://dev.mysql.com/worklog/task/?id=13442
- JoshTriplett 6y agoIt's universally faster if you compress threaded, and otherwise it's generally still a win.
- m463 6y agoI've never heard of zstd (thanks!), but it seems it's right under my nose. "Arch Linux added support for zstd as a package compression method in October 2019 with the release of the pacman 5.2 package manager, and in January 2020 switched from xz to zstd for the packages in the official repository. Arch uses zstd -c -T0 --ultra -20 -, the size of all compressed packages combined increased by 0.8% (compared to xz), the decompression speed is 1300% faster, decompression memory increased by 50 MiB when using multiple threads, compression memory increases but scales with the number of threads used." https://en.wikipedia.org/wiki/Zstandard https://en.wikipedia.org/wiki/Zstandard