2 ms·
For bigger workflows, this declarative pattern is already implemented by orchestrators like Dagster, Flyte, and recently Airflow; e.g., https://dagster.io/blog/
by esafak 1y ago
For bigger workflows, this declarative pattern is already implemented by orchestrators like Dagster, Flyte, and recently Airflow; e.g., https://dagster.io/blog/declarative-scheduling https://dagster.io/blog/declarative-scheduling [fixed]
- ycombiredd 1y agothis 404's for me
- jpitz 1y agoAre you talking about Airflow Datasets and data-aware scheduling? https://airflow.apache.org/docs/apache-airflow/2.4.0/release_notes.html#airflow-2-4-0-2022-09-19 https://airflow.apache.org/docs/apache-airflow/2.4.0/release... Isn't that about as recently as Dagster?
- esafak 1y agoYes, asset-aware scheduling.