4 ms·
+ totally agree with that. There is a use case when you can improve performance by keeping compressed (LZ4) data in RAM and decompressing by small blocks that
by zX41ZdbW 4y ago
+ totally agree with that.
There is a use case when you can improve performance by keeping compressed (LZ4) data in RAM and decompressing by small blocks that fit in cache. This is demonstrated by ClickHouse[1][2] - the whole data processing after decompression fits in cache, and compression saves the RAM bandwidth.
[1] https://presentations.clickhouse.com/meetup53/optimizations/ https://presentations.clickhouse.com/meetup53/optimizations/
[2] https://github.com/ClickHouse/ClickHouse https://github.com/ClickHouse/ClickHouse