4 ms·
Kafka: A distributed pub/sub messaging system from LinkedIn
- angelbob 16y agoI'm against naming software anything where your first mental reaction is "turn into a cockroach". It looks like a good software tool with a real use case, though, naming aside.
- Charuru 16y agoSeriously, the first thing I thought was, is this going to be really hard to develop for?
- jacques_chester 16y ago> I'm against naming software anything where your first mental reaction is "turn into a cockroach". Or that using it will be a trial.
- tlack 16y agoCan anyone summarize other software options in the pub/sub market for me? I have a project now that uses Redis' BLPOP with a timeout to implement something similar to pub/sub, but I'd like a more robust solution that does that kind of thinking for me. Kafka looks interesting but I'd like to find something built in C or Erlang due to inherent and irrational distrust for anything running on jvm.
- lrm242 16y agoFeatures, pros, cons, etc will all vary with these, but here are a few you can consider: * RabbitMQ -- built with Erlang * ZeroMQ -- built with C++ * OpenAMQ -- built with C++
- aaronblohowiak 16y agoActiveMQ - Java, but it talks STOMP so you can use it with anything. I'd go with 0mq or ActiveMQ, depending on your use case. Though, these aren't distributed, as Kafka claims to be.
- skyfallsin 16y agoIf you want to go the XMPP route, ejabberd's mod_pubsub. Written in erlang, newer versions can be either Mnesia or db-backed
- noste 16y agoRedis 2.0.0+ has built-in support for pub/sub: http://code.google.com/p/redis/wiki/PublishSubscribe http://code.google.com/p/redis/wiki/PublishSubscribe
- tlack 16y agoUnfortunately I believe this is optimized for long-running connections which I don't always have the luxury of maintaining
- deleted 16y ago[deleted]
- SpikeGronim 16y agoMaking the message IDs equal to the byte offset of the message in the history of all messages for the topic/partition is a neat trick to avoid indexing overhead. "Any software problem can be solved by adding another layer of indirection. Except, of course, the problem of too much indirection." - Steve Bellovin of AT&T Labs