3 ms·
Although I think it's bigger in the data-eng space, no reason Airflow couldn't do this. We have a single-instance Airflow box running most of our periodic jobs
by mattbillenstein 9y ago
Although I think it's bigger in the data-eng space, no reason Airflow couldn't do this. We have a single-instance Airflow box running most of our periodic jobs just as simple bash commands usually wrapping python scripts -- this works pretty well.
- sverhagen 9y agoThis turns out a great solution, Airflow ticks a lot of boxes for us, and we are likely pursuing that option. Thank you!