4 ms·
I´m waiting for a compact data-structure such as RocksDB. I store TBs of data and MySQL and MyRocks are miles ahead on this department compared to Postgres. I p
by bratao 4y ago
I´m waiting for a compact data-structure such as RocksDB. I store TBs of data and MySQL and MyRocks are miles ahead on this department compared to Postgres. I prefer to run from sharding and distributed solutions for now.
- riku_iki 4y agoI am curious what specifically makes RocksDB compact comparing to Postgress? How you decided it is more compact?
- zX41ZdbW 4y agoSimply by larger sizes of compressed blocks, which are limited to page size in Postgres, and by improving the data locality by sorting, which is inherent for LSM-trees. But if you want higher compression, you need to consider column-oriented DBMS, such as ClickHouse[1]. They are unbeatable in terms of data compression. [1] https://github.com/ClickHouse/ClickHouse https://github.com/ClickHouse/ClickHouse Disclaimer: I'm a developer of ClickHouse.
- riku_iki 4y agoas another comment mentioned, postgres approach is outsource compression to filesystem..
- nightfly 4y agoPostgres on top of ZFS with compression on gives about 4x more efficient storage for the numerically/time-series centric database I help manage Edit: Current on-disk size is 5.34TiB and logical size is 20.3TiB so closer to 3.8x savings really