4 ms·
Ofair will increase throughput in a queue where you have mixed-length tasks, because in a default configuration long tasks will block the queue from starting ne
by taylorhughes 11y ago
Ofair will increase throughput in a queue where you have mixed-length tasks, because in a default configuration long tasks will block the queue from starting new tasks. I believe this is because the main process distributes some number of tasks, waits for them to finish, then distributes another set of tasks, and so on. (Would love more clarity on this — I haven't dug into it too much.)
Assuming most Celery task queue work involves network requests that can be unpredictable, I think Ofair is a more sensible/understandable default.