3 ms·
That's exactly my issue. I have a crawler that collects data and stores into Datastore. I need to periodically scoop up the snapshots and export them into BigQu
by obulpathi 10y ago
That's exactly my issue. I have a crawler that collects data and stores into Datastore. I need to periodically scoop up the snapshots and export them into BigQuery, then run the visualizations. I want my visualization to be live and also don't want the overhead of scooping the data.
- skybrian 10y agoUsing App Engine, I schedule task queue tasks to insert rows into a BigQuery table on the fly [1]. It only works for inserts, though. [1] https://cloud.google.com/bigquery/streaming-data-into-bigquery https://cloud.google.com/bigquery/streaming-data-into-bigque...
- obulpathi 10y agoThanks! And yes, as you mentioned, the problem is that it works only for inserts. I use Datastore as my primary database. So requesting for supporting Datastore from Datastudio.