For a while I was using my own custom written job distribution system built on the database but then I discovered Gearman and since I implemented it I have seen

For a while I was using my own custom written job distribution system built on the database but then I discovered Gearman and since I implemented it I have seen increased reliability and productivity with creating new jobs. I do not recommend rolling your own system. Use something that is already built as a server to accomplish the task. Amazon SQS is also a good solution.