3 ms·
Is there a reason not to consider apache airflow? https://airflow.apache.org/ https://airflow.apache.org/ You could run it on a digital ocean droplet so you do
by dswalter 7y ago
Is there a reason not to consider apache airflow? https://airflow.apache.org/ https://airflow.apache.org/
You could run it on a digital ocean droplet so you don't have to worry about your laptop turning off. It covers retry and cron-style job kickoffs.
- demosito666 7y agoComplexity, effectively not supporting shorter scheduling interval (if you need to run something more frequently than every 20 minutes, beware), some bugs don't get fixed for years and are very hard to debug. We ended up restating the scheduler on regular Cron to kick stale task queue.