Hey HN - I wrote this post about building a highly scalable event processor compatible with the analytics.js spec using Kinesis, Spark, Airflow, and Redshift.

Hey HN - I wrote this post about building a highly scalable event processor compatible with the analytics.js spec using Kinesis, Spark, Airflow, and Redshift. I hope it's useful to others interested in exploring Spark more.