54 ms·
Well written. I think that airflow is being enforced in organizations as the main orchestrator even though it's not always the right too for the job. In additio
by idomi 5y ago
Well written. I think that airflow is being enforced in organizations as the main orchestrator even though it's not always the right too for the job. In addition, organizations has to enforce a micro-services approach to have modular components. Besides that managing those frameworks is a nightmare. We built Ploomber (https://github.com/ploomber/ploomber https://github.com/ploomber/ploomber) specifically for this reason, modular components and easy deployments. It standardize your pipelines and allows you to deploy seamlessly on Airflow, Argo (Kubernetes), Kubeflow and cloud providers.
- mansoon 5y agoI strongly disagree, having been part of efforts to use microservices in this space.