2 ms·
Various -> Airflow -> BigQuery -> Looker We have a variety of data sources, from Mixpanel to PostgreSQL to black-box systems that can only dump out CSV files.
by wrs 7y ago
Various -> Airflow -> BigQuery -> Looker
We have a variety of data sources, from Mixpanel to PostgreSQL to black-box systems that can only dump out CSV files. We use Airflow to manage pulling from those, doing some transforms, and writing everything into BigQuery. Looker then handles the reporting and browsing.