5 ms·
Can one use NSQ as a replacement for Kafka?
by nivertech 12y ago
Can one use NSQ as a replacement for Kafka?
- DAddYE 12y agoDepends on how you use Kafka, but yes overall you can.
- chuhnk 12y agoPosed this question to the creator of NSQ, Matt Reiferson just a few minutes ago. His response https://twitter.com/imsnakes/status/559827559806808069 https://twitter.com/imsnakes/status/559827559806808069
- walls 12y agoKafka offers persistence, which seems extremely rare in distributable queue. (Is it even available outside of Kafka?) On that note, what is everyone using these queues for that they can ignore durability?
- retr0h 12y agoAlso, Kafka guarantees message order, where NSQ does not. This can be dealt with in the client, but something to note.
- yeukhon 12y agoRabbit offers persistence.
- sytringy05 12y agoThe standard JMS spec supports durable queues and topics. Generally a nightmare to manage though - trying to track down a unconsumed message on a clustered durable topic with lots of subscribers is like trying to find a needle in a stack of needles.
- lxfontes 12y agoAt Uken Studios we use NSQ as a chain of queues for log processing. rails -> fluentd -> NSQ (firehose) -> log splitter (python script) -> NSQ (elasticsearch, s3, hadoop) We have this setup live since November and processed more than 25b messages without hiccups.