4 ms·
No, compression technology has advanced a lot since DEFLATE. Today's general purpose compressors beat DEFLATE at all points on the Pareto frontier (any network/
by wolf550e 6y ago
No, compression technology has advanced a lot since DEFLATE. Today's general purpose compressors beat DEFLATE at all points on the Pareto frontier (any network/disk speed, any compression ratio vs CPU time trade-off). Use zstd. If you need even more speed, use lz4. If you need even more compression, use LZMA (or if it's natural language text use ppmd).
- zxcvbn4038 6y agoAgree that zstd has performance but memory requirements are potentially orders larger, there is no browser support, and you can’t count on people having decompressor installed. It’s good if your compressing data for your use but it doesn’t have the reach of deflate. Maybe that will change in the future.
- vanderZwan 6y agoHow many orders larger, and larger than what? The 32kb? A megabyte is two orders larger than that, a gigabyte five orders larger. We got quite a bit of leeway here..
- wolf550e 6y agozstd and lz4 can be run in small memory footprints and without heap memory allocation and I bet zstd would beat DEFLATE in 32KB too (just not as much). It's not as popular yet, yes, but for internal use, including using HTTP content encoding if both your server and client support it, it's great.