blimey indeed. This is a lot of work to set up. I think you'll see more platforms that offer this set up as a service: * cheap storage / datalake * pipelines

blimey indeed. This is a lot of work to set up. I think you'll see more platforms that offer this set up as a service: * cheap storage / datalake * pipelines to get data to storage * BI / dashboards on top of the storage We're doing this at Definite (https://www.definite.app/ https://www.definite.app/) with Iceberg (same as in this post) + DuckDB as a query engine.