3 ms·
There's no mention of AWS's own existing workflow management systems - Step Functions and AWS Glue. Would be interested to see AWS's own advice on when to use o
by sparsely 6y ago
There's no mention of AWS's own existing workflow management systems - Step Functions and AWS Glue. Would be interested to see AWS's own advice on when to use one over the other.
- amzn-throw 6y agoThis was developed internally by the Orchestration organization - that builds Step Functions and maintains AWS Simple Workflow [1], or have you forgotten the original AWS workflow system :) I don't think of Glue as a generic workflow system the way the others are - it's definitely much more optimized for ETL use cases. With time, I'm sure there'll be more detailed guidance on Step Functions vs Apache Airflow, but the simple guidance might be that Step Functions is a fully AWS-native (and serverless) orchestration engine. Whereas, of course Apache Airflow is an open source project with a diverse ecosystem of other plugins. [1] https://aws.amazon.com/swf/ https://aws.amazon.com/swf/