4 ms·
Not quite. All of these are open-source projects but they are very different in many aspects: * Apache Flink Sophisticated stream processing framework with fo
by mxmxm 8y ago
Not quite. All of these are open-source projects but they are very different in many aspects:
* Apache Flink
Sophisticated stream processing framework with focus on robustness (managed memory) and correctness (exactly-once semantics)
* Apache Flume
Tailored towards log data.
* Apache Storm
First stream processing framework. Legacy.
* Apache Samza
Only used at LinkedIn. Tight to Hadoop's YARN.
* Apache Spark
Only great in batch processing.
* Apache Apex
Dead project. Tight to Hadoop's YARN.
* Apache Kafka
A distributed message queue with simple stream processing built on top via the Confluent Platform.
- dankohn1 8y agoNice list. There are also non-Apache projects like NATS, hosted by CNCF. Here are the 19 streaming and messaging projects and products that CNCF is tracking: https://landscape.cncf.io/category=streaming-messaging&format=card-mode&grouping=category https://landscape.cncf.io/category=streaming-messaging&forma...
- michaelmior 8y ago> Only used at LinkedIn. And Intuit, Uber, Netflix, VMWare, .... https://cwiki.apache.org/confluence/display/SAMZA/Powered+By https://cwiki.apache.org/confluence/display/SAMZA/Powered+By