6 ms·
Kafka is a high performance, persistent message queue. Storm is distributed stream processing. The two work together very well. Often, a server will publish m
by akbar501 12y ago
Kafka is a high performance, persistent message queue.
Storm is distributed stream processing.
The two work together very well. Often, a server will publish messages to Kafka (or another queue), which are then read and processed by Storm.
- throwaway1979 12y agoInteresting question and response. I haven't used either but read about both systems independently. A bit more googling and I found: http://www.slideshare.net/gschmutz/kafka-andstromeventprocessinginrealtime http://www.slideshare.net/gschmutz/kafka-andstromeventproces... Slides 42 and 43 describe an architecture with all three ... hadoop, storm and kafka. Seems like a beast and I don't have applications but pretty cool combo of technologies.
- erichmond 12y agohttp://manning.com/marz/ http://manning.com/marz/ - this is often the trifecta used in the "lambda architecture", coined by nathan marz. This is also the system they built @ backtype to do their real-time analytics system.
- phunge 12y agoAlso worth checking out http://radar.oreilly.com/2014/07/questioning-the-lambda-architecture.html http://radar.oreilly.com/2014/07/questioning-the-lambda-arch... from Jay Kreps, who's part of the Kafka braintrust.