4 ms·
Google Cloud Function streaming inserts to BigQuery. Then analysis is carried out with the BigQuery UI (ad hoc analyses or scheduled queries for pipelines), Dat
by scottfr 7y ago
Google Cloud Function streaming inserts to BigQuery. Then analysis is carried out with the BigQuery UI (ad hoc analyses or scheduled queries for pipelines), DataStudio (visualizations -- we use this infrequently, it's really not great) or Google Colab (statistical analyses, complex visualizations).
The pros are:
* full SQL access to the data via BigQuery
* simple to set up (yes, you have to write custom code; but a basic implementation is on the order of a couple dozen of lines of code)
* we have full ownership of the data across the pipeline (better for user privacy than using another 3rd party)
Prior to this we used Google Analytics, but their paid solution is too expensive for us and their analytics/aggregation API (though quite powerful) samples a subset of the data which was not acceptable for some of our use cases.
- steve76 7y agoMy biggest problem with GA is that api key. If it ever leaks public, people can hack you. I would like a guest account please, some way to do it without authorization or authentication. They sample anyways. .. ... ... What I'm working on is using discord app bots. Have public guest channels, and see if my team is good enough to see what's real and what's fake. Great with auditing. Hey! You want to take out Pro/E, Solidworks, AutoCAD, Catia, EVERYONE? I'm working on PDM ERP CAD Parametric standards. Just host SVG through github! RFC Please: https://twitter.com/thisbounty_com/status/1152390554820497410 https://twitter.com/thisbounty_com/status/115239055482049741...