The following comes to mind Python based: http://www.celeryproject.org/ http://www.celeryproject.org/ <-- async task queue https://github.com/spotify/luigi

The following comes to mind Python based: http://www.celeryproject.org/ http://www.celeryproject.org/ <-- async task queue https://github.com/spotify/luigi https://github.com/spotify/luigi <-- more pipe line centric There are many like it. RQ(more bare bone)