5 ms·
Agreed that if you have the control (and potentially the time depending on the algorithm), type specific compression is the way to go. Having said that, zstd be
by Smerity 9y ago
Agreed that if you have the control (and potentially the time depending on the algorithm), type specific compression is the way to go. Having said that, zstd beats Snappy handily for text ^_^
On enwik8 (100MB of Wikipedia XML encoded articles, mostly just text), zstd gets you to ~36MB, Snappy gets you to ~58MB, while gzip will get you to 36MB. If you turn up the compression dials on zstd, you can get down to 27MB - though instead of 2 seconds to compress it takes 52 seconds on my laptop. Decompression takes ~0.3 seconds for the low or high compression rate.
- wolf550e 9y agoppmd will get you better compression on text (better than zstd and even better than lzma), but it is slow to compress and decompress. Use `7z a -m0=PPMd demo.7z demo.txt`
- hokkos 9y agoWhy not use a XML/XSD specific compression like EXI for that ? https://www.w3.org/TR/exi-primer/ https://www.w3.org/TR/exi-primer/
- cldellow 9y agoIt really is mostly just text. It's not _quite_ <Article>... [30 kb of text] ...</Article> but almost.