4 ms·
Having always been on AWS and using Glue Spark Jobs for my jobs, I've never felt any benefit of using Airflow for orchestration over Glue Workflows. I can under
by mkw5053 5y ago
Having always been on AWS and using Glue Spark Jobs for my jobs, I've never felt any benefit of using Airflow for orchestration over Glue Workflows. I can understand some people not wanting to deal with vendor lock-in. I'm curious what others opinions are.
- higeorge13 5y agoFor glue jobs you probably don’t need something more. However step functions is the norm for creating workflows in aws nowadays.