> The application of compressors for text statistics is fun, but it's a software equivalent of discovering that speakers and microphones are in principle the sa

> The application of compressors for text statistics is fun, but it's a software equivalent of discovering that speakers and microphones are in principle the same device. I think it makes sense to explore it from practical standpoint, too. It’s in Python stdlib, and works reasonably well, so for some applications it might be good enough. It’s also fairly easy to implement in other languages with zstd bindings, or even shell scripts: $ echo 'taco burrito tortilla salsa guacamole cilantro lime' > /tmp/tacos.txt $ zstd --train $(yes '/tmp/tacos.txt' | head -n 50) -o tacos.dict [...snip] $ echo 'racket court serve volley smash lob match game set' > /tmp/padel.txt $ zstd --train $(yes '/tmp/padel.txt' | head -n 50) -o padel.dict [...snip] $ echo 'I ordered three tacos with extra guacamole' | zstd -D tacos.dict | wc -c 57 $ echo 'I ordered three tacos with extra guacamole' | zstd -D padel.dict | wc -c 60