4 ms·
> SQS is a particularly shitty queue. Do you have any other recommendations for queue systems that can handle a million messages per minute (our use case)?
by mrep 10y ago
> SQS is a particularly shitty queue.
Do you have any other recommendations for queue systems that can handle a million messages per minute (our use case)?
- chx 10y agoA million messages per minute ? How's that a problem? Please see http://bravenewgeek.com/dissecting-message-queues/ http://bravenewgeek.com/dissecting-message-queues/ Almost all of the systems tested hit 17k / s (aside from NSQ) -- on a laptop. NATS (gnatsd) hits 0.2M per second, that's a magnitude above what you need and that's a brokered system, if your task fits with a brokerless one then nanomsg is yet another magnitude. I do not particularly see where the problem really is?
- mrep 10y agoOur messages range from a few KB to a few MB (we store a pointer to S3 for the large ones) but that look pretty interesting. Thanks