5 ms·
> streams WAL changes straight into Apache Iceberg on S3, queryable from psql via an embedded DuckDB Why not use Ducklake instead of Apache Iceberg? Wouldn't t
by kshri24 4mo ago
> streams WAL changes straight into Apache Iceberg on S3, queryable from psql via an embedded DuckDB
Why not use Ducklake instead of Apache Iceberg? Wouldn't that simplify the architecture substantially?
- vira28 4mo agoFrom what I understand Ducklake needs a dedicated metadata database and it also ties to DuckDB land wherease with Iceberg many engines can query directly.
- kshri24 4mo agoYou are already using Postgres in your setup so why not just use Postgres itself as metadata database? It is a much better setup than using Iceberg [1]. > and it also ties to DuckDB land wherease with Iceberg many engines can query directly. Ducklake can also be queried by many engines [2]. Though not as exhaustive as Iceberg. [1]: https://www.youtube.com/watch?v=-PYLFx3FRfQ https://www.youtube.com/watch?v=-PYLFx3FRfQ [2]: https://ducklake.select/docs/stable/#list-of-ducklake-clients https://ducklake.select/docs/stable/#list-of-ducklake-client...