4 ms·
Finally! We use both Cloud SQL (Postgres) and BigQuery. Given both are managed GCP products you’d expect a simple way to replicate Postgres into BigQuery. Inste
by mousetree 4y ago
Finally! We use both Cloud SQL (Postgres) and BigQuery. Given both are managed GCP products you’d expect a simple way to replicate Postgres into BigQuery. Instead we’ve had to pay for Stirch/Fivetran/Airbyte or some janky “BigQuery external connections” to do this. Very happy they’re finally supporting an obvious use case. Surprise it’s taken so long
- mywittyname 4y agoWe've been using the external queries feature of BQ against Cloud SQL, then redirecting the output to a new table. It's not perfect, but it's functional, so long as your tables are very simple.
- diceduckmonk 4y agoIt’s bonkers GCP Web Console doesn’t even have a way to query CloudSQL. And if your instance is on a private IP, you can’t use GCP’s CLI to query it, either. The workaround ? We spun up a “bastion” GCE instance to run PSQL queries from.