3 ms·
I think this is meant to be a parallel to things like celery and gearman, i.e. a task queue. A table mapping between AWS services and what components they repl
by newhouseb 15y ago
I think this is meant to be a parallel to things like celery and gearman, i.e. a task queue. A table mapping between AWS services and what components they replace in a typical DIY stack would be helpful for a lot of people (i.e. SQS = RabbitMQ, SWF = celery, ELB = nginx, DynamoDB = Cassandra(?)).
- JeffJenkins 15y agoCerery doesn't do workflows with dependencies, just tasks. This is more like Storm: https://github.com/nathanmarz/storm https://github.com/nathanmarz/storm
- kennu 15y agoI wonder if Celery could still use SWF as its backend in the future? Instead of having to manage your own EC2 instances and databases for the Celery daemons.
- newhouseb 15y agoWell celery does have subtasks that it can wait and join on (see http://ask.github.com/celery/userguide/tasksets.html http://ask.github.com/celery/userguide/tasksets.html), but I suppose that the logic to do such things would have to occur within a running task as opposed to SWF where such things are handled by the platform itself.