5 ms·
Anything to go the other way? I’d like to use BQ to warehouse and be able to examine but PG to do heavy analytics due to the cost once you really start doing ma
by api 4y ago
Anything to go the other way? I’d like to use BQ to warehouse and be able to examine but PG to do heavy analytics due to the cost once you really start doing many repeated queries.
I guess I could just dump directly to CSVs and download but BQ is a nice convenient bottomless data bucket.
- buremba 4y agoYou can utilize BI engine for this exact purpose: https://cloud.google.com/bigquery/docs/bi-engine-query https://cloud.google.com/bigquery/docs/bi-engine-query
- mritchie712 4y agodo you already have an ETL pipeline to BQ? You could use Airbyte[0] for pg to bq. It's pretty heavy if this is your only source, but should work well if you need to query the pg data in bq frequently. 0 - https://airbyte.com/connections/PostgreSQL-to-BigQuery https://airbyte.com/connections/PostgreSQL-to-BigQuery
- rockostrich 4y agoThey said "the other way" so BQ to Postgres.
- muspimerol 4y agoBigQuery and Postgres are both sources and destinations in Airbyte, the data can flow either way.
- api 4y agoAirbyte looks nice! thanks.