4 ms·
A framework that is similar to this in python (that I am one of the authors of) [1] (and [2] for more in-depth docs/examples). It's used in openstack (which som
by harlowja 12y ago
A framework that is similar to this in python (that I am one of the authors of) [1] (and [2] for more in-depth docs/examples). It's used in openstack (which some people may have heard of) where appropriate (and where desirable...) to help in consistent, scalable execution using a flow like methodology to declaratively describe workflows (and execute them using various strategies/engines).
[1] https://github.com/openstack/taskflow https://github.com/openstack/taskflow
[2] http://docs.openstack.org/developer/taskflow/ http://docs.openstack.org/developer/taskflow/
- samuell 12y agoThe one I did know in python was PaPy: https://code.google.com/p/papy/ https://code.google.com/p/papy/ Will have to have a closer look at this one as well, though.
- harlowja 12y agoCool, looks similarish; feel free to jump on freenode (usually during weekdays) and ping me, channel #openstack-state-management or #openstack-oslo Pretty diagram also @ https://wiki.openstack.org/wiki/TaskFlow#Big_picture https://wiki.openstack.org/wiki/TaskFlow#Big_picture ;)
- i000 12y agoAuthor of PaPy here. Thanks for giving PaPy a try. Although PaPy [https://github.com/mcieslik-mctp/papy https://github.com/mcieslik-mctp/papy] has never gained traction :(, I have been using it daily for over 5 years (no bugs in the scheduler so far). By now our PaPy based genomics pipelines have probably processed petabytes of data.
- SEJeff 12y agoJust gonna say that task flow is wonderful software that is usable outside of the giant openstack ecosystem. I use it for some internal projects and am quite pleased with it.