4 ms·
Hey! I'm one of the makers of pg_analytics/ParadeDB. We store tables column-based. You can do CREATE TABLE (...) USING deltalake; when using ParadeDB and it wi
by philippemnoel 3y ago
Hey! I'm one of the makers of pg_analytics/ParadeDB.
We store tables column-based. You can do CREATE TABLE (...) USING deltalake; when using ParadeDB and it will be stored column-based (and soon, with support for also querying cloud object stores!)
- ako 3y agoLooks interesting, but exactly what is missing when just adding duckdb to Postgres. Why did you go with delta lake over iceberg?
- philippemnoel 3y agoDuckDB is in-memory. It makes sense as a in-memory columnar cache. We went with DataFusion to benefit from the deep integration it has into the ecosystem with Arrow, Parquet, etc. As for Delta Lake, we would've loved to do Iceberg but the Rust crate for Iceberg is very new, and doesn't have enough functionalities yet. We're tracking the project and planning to contribute, so that we can add support for Iceberg eventually