3 ms·

Kafka has come a long way. Kudos to confluent team. I came across some projects which claim to be full or partial alternative to Kafka with better scalability

Kafka has come a long way. Kudos to confluent team. I came across some projects which claim to be full or partial alternative to Kafka with better scalability and less operational overhead. Jocko - https://github.com/travisjeffery/jocko https://github.com/travisjeffery/jocko SMF - https://senior7515.github.io/smf/ https://senior7515.github.io/smf/ MapR-ES - https://mapr.com/blog/kafka-vs-mapr-streams-why-mapr/ https://mapr.com/blog/kafka-vs-mapr-streams-why-mapr/ Has anyone tried it in their project ?

manigandham 9y ago
None of those are alternatives. Jocko's creator now works for Confluent and it's not production ready or supported, more of a hobby project to recreate kafka in go without zookeeper. SMF is a prototype RPC system and libraries based on the C++ Seastar framework, not a messaging system in itself. MapR-ES is part of the MapR hadoop/data platform and also not standalone. If you want alternatives then look at NATS + NATS Streaming [1] or Apache Pulsar [2]. 1. http://nats.io http://nats.io 2. https://pulsar.apache.org/ https://pulsar.apache.org/
- truth_seeker 9y ago
  Thanks for sharing the Jocko's creators story. Yes. MapR-ES comes with its own File system and tool chain but its more closer alternative to Kafka than NATS as it follows Kafka 0.9 API and can act as drop in replacement. Although it does not support exactly once semantics yet.
  - manigandham 9y ago
    Usually alternatives are about providing similar functionality, not the exact interface. If you just want a Kafka API then there are multiple adapters available for most other messaging systems, including pulsar. MapR is an entire data platform and suite of services, one of which is the ES (event streams) offering. It's not drop-in for Kafka unless you're already running the MapR platform which is much more involved than just running Kafka.
  - lmsp 9y ago
    actually, pulsar just supports kafka 0.10 api in the recent apache release. it might be worth checking it out as a drop in replacement. https://github.com/apache/incubator-pulsar/releases/tag/v1.20.0-incubating https://github.com/apache/incubator-pulsar/releases/tag/v1.2...
- guiye 9y ago
  maybe another alternative here https://rocketmq.apache.org/ https://rocketmq.apache.org/

manigandham 9y ago

None of those are alternatives. Jocko's creator now works for Confluent and it's not production ready or supported, more of a hobby project to recreate kafka in go without zookeeper. SMF is a prototype RPC system and libraries based on the C++ Seastar framework, not a messaging system in itself. MapR-ES is part of the MapR hadoop/data platform and also not standalone. If you want alternatives then look at NATS + NATS Streaming [1] or Apache Pulsar [2]. 1. http://nats.io http://nats.io 2. https://pulsar.apache.org/ https://pulsar.apache.org/

truth_seeker 9y ago
Thanks for sharing the Jocko's creators story. Yes. MapR-ES comes with its own File system and tool chain but its more closer alternative to Kafka than NATS as it follows Kafka 0.9 API and can act as drop in replacement. Although it does not support exactly once semantics yet.
- manigandham 9y ago
  Usually alternatives are about providing similar functionality, not the exact interface. If you just want a Kafka API then there are multiple adapters available for most other messaging systems, including pulsar. MapR is an entire data platform and suite of services, one of which is the ES (event streams) offering. It's not drop-in for Kafka unless you're already running the MapR platform which is much more involved than just running Kafka.
- lmsp 9y ago
  actually, pulsar just supports kafka 0.10 api in the recent apache release. it might be worth checking it out as a drop in replacement. https://github.com/apache/incubator-pulsar/releases/tag/v1.20.0-incubating https://github.com/apache/incubator-pulsar/releases/tag/v1.2...
guiye 9y ago
maybe another alternative here https://rocketmq.apache.org/ https://rocketmq.apache.org/