It's interesting seeing the various stacks being used...Here at One Medical: [ onemedical.com, mixpanel, Google Sheets, Salesforce, etc ] -> S3 (Amazon EMR) ->

It's interesting seeing the various stacks being used...Here at One Medical: [ onemedical.com, mixpanel, Google Sheets, Salesforce, etc ] -> S3 (Amazon EMR) -> [ Tableau, Aurora MySQL ] It's a nice & clean stack for data engineering. Airflow is used for orchestration and is heavily customized with plugins. Zeppelin notebooks are used by most analysts. We'll probably be replacing Aurora MySQL w/an MPP database like Snowflake or Redshift. MySQL is a crutch, but easy to deploy and manage to a point. Several python frameworks also do various ETL & data science functions, but everything generally revolves around S3 & Airflow. Amazon EMR is a great swiss army knife for ETL. Moving between Pig, Spark & Hive is trivial. Tableau is a bit of a challenge. Tableau seems to give users too much rope to hang themselves with. Also, we're hiring: https://www.onemedical.com/careers/ https://www.onemedical.com/careers/