2 ms·
If you're going to build a framework like this, please please put your consistency behavior and retry behavior at the top of your docs.
by vorpalhex 4y ago
If you're going to build a framework like this, please please put your consistency behavior and retry behavior at the top of your docs.
- ancieque 4y agoYes, 100% this. Too many frameworks claim that they are "easy" just to find out they left out things that other older frameworks have already solved. While we are on this: Do you know of any task scheduler framework that is similar to celery, but has better guarantees around task execution than what acks_late= True gives you? I always find myself building a system that stores the really important Tasks in Postgres so that I can recover from anything in the broker or celery crashing. What i use celery for is just scheduling these Tasks by creating a celery job with the Postgres Job ID as the parameter. Then, to detect if something went horribly wrong, I have a sweeping job that checks if any job in Postgres has not run in celery for some reason. If that is the case, we just re-queue the job.