3 ms·
How does BigQuery support updates? IIRC in BigQuery you have to overwrite whole partitions. At least in Hive you can have secondary partitions to mitigate this.
by indogooner 8y ago
How does BigQuery support updates? IIRC in BigQuery you have to overwrite whole partitions. At least in Hive you can have secondary partitions to mitigate this.
- georgewfraser 8y agoBigQuery has had DML for over a year. There are quotas but the quotas keep rising and they can manually increase your quota on request.
- indogooner 8y agoThanks. I checked the quotas. They seem to have increased to 200 per table. Last time I checked (last year) they were pretty limiting. I like the MERGE statement though. Hope it comes out of Beta soon. The pricing is for full scan so it is not just for in-place update but charged with bytes scanned for selected columns for scanned partitions.