3 ms·
I update/upgrade/switch over to zstd (from older compressors) wherever I'm updating or revamping any of my data pipelines. Looks like a win^3 for me: 1) It's pr
by ljosifov 3y ago
I update/upgrade/switch over to zstd (from older compressors) wherever I'm updating or revamping any of my data pipelines. Looks like a win^3 for me:
1) It's probably either in the top-X or #1 in any of the usual compression metrics size/speed/convenience/ease etc.
2) Can do --rsyncable and create rsync friendly files at tiny size cost.
3) In the rare occasion I need there's $ zstd -c file1 >file.zst; zstd -c file2 >>file.zst, then $ zstd -dc file.zst will produce out $ cat file{1,2}