3 ms·
Next thing you know you'll have systemd.
by _wire_ 1y ago
Next thing you know you'll have systemd.
- datadrivenangel 1y agoOr worse, airflow!
- UltraSane 1y agoAirflow can be frustrating but when it works it is so satisfying.
- globular-toast 1y agoI think mistaking Airflow for a mere "task scheduler" is part of that frustration.
- flakes 1y agoAfter using Argo Workflows, I don't think I will ever return to Airflow. Kubernetes is not an easy system to manage, but managing an Airflow setup is somehow worse. The story around disaster recovery and scheduler redundancy was an absolute nightmare for me.
- datadrivenangel 1y agoArgo workflows is much more painful for data processing than Airflow in my experience.
- flakes 1y agoIt’s a tradeoff. Ease of modeling the pipelines vs ease of managing the infrastructure. Im not really a fan of either syntax for defining DAGs, but they're the best options out there imo.