2 ms·
I can't recall if they actually implemented or just talked about it, but during the ZFS team meetings there was some discussion about using LZ4 as a "compressio
by magicalhippo 4y ago
I can't recall if they actually implemented or just talked about it, but during the ZFS team meetings there was some discussion about using LZ4 as a "compression canary", to determine if it was worth attempting Zstandard. That is, first try compressing with LZ4, and if it did compress, do actual compression with Zstandard.
IIRC the argument went that LZ4 had a very quick bail-out routine, and quite fast compression, so the overall overhead would be quite small, at least for the higher Zstandard compression levels.
- Dagger2 4y agoThey implemented it; it landed in May: https://github.com/openzfs/zfs/commit/f375b23c https://github.com/openzfs/zfs/commit/f375b23c