In the past used both Celery and RabbitMQ for some custom services... however we also used to use Qube (A render farm manager) to link long running tasks togeth

In the past used both Celery and RabbitMQ for some custom services... however we also used to use Qube (A render farm manager) to link long running tasks together in a dependency chain which was workflow specific. Some times job could take days to finish (doing a water simulation in a 4k res sequence) Qube has resource constraints per job as well as number of tries and so on. Those would all be configured at job (think workflow) submission time.