3 ms·
Metaflow sits on top of Maestro, and neither replaces the other > ...Users can use Metaflow library to create workflows in Maestro to execute DAGs consisting o
by savin-goyal 2y ago
Metaflow sits on top of Maestro, and neither replaces the other
> ...Users can use Metaflow library to create workflows in Maestro to execute DAGs consisting of arbitrary Python code.
from https://netflixtechblog.com/orchestrating-data-ml-workflows-at-scale-with-netflix-maestro-aaa2b41b800c https://netflixtechblog.com/orchestrating-data-ml-workflows-...
The orchestration section in this article (https://netflixtechblog.com/supporting-diverse-ml-systems-at-netflix-2d2e6b6d205d https://netflixtechblog.com/supporting-diverse-ml-systems-at...) goes into detail on how Metaflow interplays with Maestro (and Airflow, Argo Workflows & Step Functions)