A (python) library that does alot of this (the parallelism, data-flow, flow construction from task units, remote execution, resumable execution...). I'm one of

A (python) library that does alot of this (the parallelism, data-flow, flow construction from task units, remote execution, resumable execution...). I'm one of the authors, it's used in various openstack projects (and more)... This article was very much along the ideas of it, so thought it useful to share. - http://docs.openstack.org/developer/taskflow/ http://docs.openstack.org/developer/taskflow/ - https://wiki.openstack.org/wiki/TaskFlow https://wiki.openstack.org/wiki/TaskFlow We recently had a brown-bag (with a community member from HP and myself from yahoo) that is shareable and maybe useful to folks @ https://docs.google.com/presentation/d/1EZoY4FE2SDjfCqMCgBRrwo7ovHF4vYZFGKjjvFvWHIE/ https://docs.google.com/presentation/d/1EZoY4FE2SDjfCqMCgBRr...