4 ms·
Apparently duckdb paired with arrow lets you work performatively on bigger than memory parquet data (I haven't tried this though)
by corford 4y ago
Apparently duckdb paired with arrow lets you work performatively on bigger than memory parquet data (I haven't tried this though)
- riezebos 4y agoArrow seems to be the common denominator for larger than ram. Polars is completely built on arrow, so the same advantages should apply. https://github.com/pola-rs/polars#handles-larger-than-ram-data https://github.com/pola-rs/polars#handles-larger-than-ram-da...