Airflow has major limitations that don't become obvious until you're already deep into it. I'd advise avoiding it myself. It's only useful if you have workload

Airflow has major limitations that don't become obvious until you're already deep into it. I'd advise avoiding it myself. It's only useful if you have workloads that are very strictly time-bounded (Every day, do X for all the data from yesterday). It's virtually impossible to manage an event-driven or for-each-file-do-Y style workflow with Airflow.