3 ms·
The centralized DAG scheduler seems like a pretty important part. How much will not having Meson hamper the usability?
by bhtucker 7y ago
The centralized DAG scheduler seems like a pretty important part. How much will not having Meson hamper the usability?
- pela 7y agoHi bhtucker, We do have plans to integrate with production-grade schedulers in the very near future. https://github.com/Netflix/metaflow/issues/2 https://github.com/Netflix/metaflow/issues/2
- vtuulos 7y agonote that Metaflow comes with a built-in DAG scheduler, so it is perfectly usable without a centralized scheduler like Meson. Integrations to Airflow or StepFunctions are on the roadmap, depending on what seems to resonate with people outside Netflix.