4 ms·
A Data Engineer’s Perspective on AWS Managed Airflow vs. AWS Step Function
- mattewong 4y agoGlad to see this. I'm in the midst of evaluating "modern cloud" ETL approaches and it seems that Airflow comes up everywhere I look, yet Step Functions seems better-- glad to see others with that perspective too. Major advantages I see are a) serverless, b) JSON-based config and c) no python lock-in. The only real disadvantages I would envision are a) AWS lock-in and b) at some volumne, server-based will be cheaper for high volume. Would love to find a cloud-vendor-neutral version of step functions that could be either serverless or not)