Ive done 2 data pipelines, one alot like what most people are are talking. The other I had to build for a startup with millions of monthly uniques but only see

Ive done 2 data pipelines, one alot like what most people are are talking. The other I had to build for a startup with millions of monthly uniques but only seed funding (cant do a 30+k a month data eng bill). Went with custom event emission->kenisis->(druid & S3) and used imply (https://imply.io/ https://imply.io/). Easy real time data analytics, auto "enrichment with druid lookups from a RDBMS, and a simple ui for slice/dice investigation metrics. All in all costed lest then the cheapest looker license.