4 ms·
+1 to this, we kick off our Sqoop jobs using Airflow - http://airbnb.io/projects/airflow/ http://airbnb.io/projects/airflow/ Airflow is very similar to Luigi;
by natekupp 10y ago
+1 to this, we kick off our Sqoop jobs using Airflow - http://airbnb.io/projects/airflow/ http://airbnb.io/projects/airflow/
Airflow is very similar to Luigi; we've been using in in production to schedule all of our workflows for ~4 months now and it's worked out really well for us.