4 ms·

not OP, but I prefer https://github.com/azkaban/azkaban https://github.com/azkaban/azkaban to airflow

• zmmmmm 6y ago
  so, workflows described in yaml? I also am a bit ambivalent about Airflow and the way workflows are built up in it, but YAML seems really weak and unlikely to handle complexity well. Also - it's entirely built around Hadoop from what I can see? Seems a limited use case compared to Airflow.
  • ttymck 6y ago
    You raise a good point, there is an apparent need for an application that retains the dags-as-code but radically simplifies the airflow architecture.
    • rywalker 6y ago
      if you like YAML-based DAGs, you can do that in Airflow with the dag-factory extension https://github.com/ajbosco/dag-factory https://github.com/ajbosco/dag-factory