3 ms·
We poked RabbitMQ, Gearman, SQS, a few others, and never got the reliability we demanded. To be fair, we're handling in the order of 50 million messages a day.
by donatj 10y ago
We poked RabbitMQ, Gearman, SQS, a few others, and never got the reliability we demanded. To be fair, we're handling in the order of 50 million messages a day.
Ended up just writing a simple file system based queue in Golang and it's working spectacularly. Just let the SSD do the work. Couple hundred loc all told. We rarely crack 10-15% cpu and memory use sits statically at around 30mb.
- stevekemp 10y agoI've gone through a few things too, eventually settled on Redis. Would be interested in seeing your queue, if it were public?
- donatj 10y agoI'd love to make it public, might be a while with company politics being what they are. We have a bad habit of not even sharing with other parts of the company.