4 ms·
FYI dataflow's bigqueryio does not use stream inserts. Instead it batches the data into many load jobs
by cobookman 9y ago
FYI dataflow's bigqueryio does not use stream inserts. Instead it batches the data into many load jobs
- oomkiller 9y agoThat is configurable, but for unbounded PCollections it appears the default is to use streaming inserts https://beam.apache.org/documentation/sdks/javadoc/2.4.0/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.Write.Method.html https://beam.apache.org/documentation/sdks/javadoc/2.4.0/org...