4 ms·
Disclosure: I work on Google Cloud. Different things! Composer (based on Apache Airflow, which we contribute to) is a general purpose workflow system. Cloud AI
by boulos 7y ago
Disclosure: I work on Google Cloud.
Different things! Composer (based on Apache Airflow, which we contribute to) is a general purpose workflow system. Cloud AI Platform Pipelines is really focused on ML pipelines, specifically, like Kubeflow (the related OSS project that we contribute to) is meant to be.
Instead, I would argue that Kubeflow has lots of overlap with Airflow. But I don't think either will be cancelled :).
- tixocloud 7y agoCurious but what’s driving the need to have a different pipeline system? As you say, Kubeflow has lots of overlap with Airflow so what’s different?