Yeah definitely streaming API. This use case is MADE for BigQuery :) Check out, as well as the blog posts on the required reading list on the topic of inserts.

Yeah definitely streaming API. This use case is MADE for BigQuery :) Check out, as well as the blog posts on the required reading list on the topic of inserts. There's also a pretty good Kafka-bq connector. It sounds like "ingest" was the big factor in your choice of a data warehouse. Regardless, I think bigquery has the best story in the industry here (but I'm biased). I'd help more hands on but sadly not online for a while :)