3 ms·
The one drawback I did note with Airflow was none of the mentioned ones, but this: It does not allow defining data dependencies at the data level. That is, in t
by samuell 5y ago
The one drawback I did note with Airflow was none of the mentioned ones, but this: It does not allow defining data dependencies at the data level. That is, in terms of individual inputs and outputs of a process or task.
I cover this issue in some detail in a blog post from a few years back:
https://rillabs.org/posts/workflows-dataflow-not-task-deps https://rillabs.org/posts/workflows-dataflow-not-task-deps