4 ms·
what stops you from running this on a container and dumping the results with a script to be queried by a reporting solution into bigquery or snowflake?
by dappermanneke 3y ago
what stops you from running this on a container and dumping the results with a script to be queried by a reporting solution into bigquery or snowflake?
- jakozaur 3y agoI already see companies with BigQuery setuped. I would like to quickly grab some data, queries and dashboards and run them in my local warehouses.
- geoHeil 3y agoIf you use bigquery in big lake mode - i.e. with parquet or iceberg or delta files on GCS (or other object store) you can easily pull in the data into duckdb as well
- geoHeil 3y agoHi, Georg - one of the authors is here. In fact, this is exactly what we argue: Keep data the consumer experience high a Paas platform (Fabric, BigLake, Databricks, SF, ...) can make a lot of sense, whereas for the best data development/creator experience a high-code solution based on solid software engineering best practices should be the preferred solution - at least in my/our(authors) opinion.