3 ms·
Column orientation is extremely important for query + storage efficiency. Furthermore, you need a distributed query engine (Athena, Bigquery etc.) and they all
by lysecret 3y ago
Column orientation is extremely important for query + storage efficiency.
Furthermore, you need a distributed query engine (Athena, Bigquery etc.) and they all support parquet.
- datadrivenangel 3y agoDuckDB is SQLite but column oriented!
- lysecret 3y agoYes we are using DuckDB right now. Love it. Works extremely well if you can partition down your data to manageable (few gbs) size.