7 ms·
Guess your were luckier? YMMV, I've found Kafka generally lives up to its terrible reputation -- and even when it doesn't, it's all somehow more difficult than
by stmw 6y ago
Guess your were luckier? YMMV, I've found Kafka generally lives up to its terrible reputation -- and even when it doesn't, it's all somehow more difficult than its initial appeal. I certainly agree with others that inclusion of Kafka in an open-source package like this would discourage me from using it.
- pranay01 6y agoCurious, is there an alternative to Kafka which would be more easier for you to adopt?
- vladsanchez 6y ago- [RedPanda|https://vectorized.io/redpanda/ https://vectorized.io/redpanda/]? - [Apache Pulsar|https://pulsar.apache.org https://pulsar.apache.org]?
- pranay01 6y agoWe had checked out both these projects. Our view was that RedPanda was still an early project ( ~1.5K stars) and Pulsar was very similar to Kafka, and Kafka was more well known compared to Pulsar
- stmw 6y agosome options: - https://pulsar.apache.org/ https://pulsar.apache.org/ - the many systems based on https://en.wikipedia.org/wiki/Advanced_Message_Queuing_Protocol https://en.wikipedia.org/wiki/Advanced_Message_Queuing_Proto... - cloud-specific queues (SNS Kinesis et al)
- TameAntelope 6y agoKafka does not fill the same use cases as these suggestions, this may be part of the trouble you were experiencing! My use of Kafka was as a "system of record", and attaching connectors to create views into the data from there. I could replay a Kafka topic into a MongoDB, run some analysis, and destroy the MongoDB instance.
- TameAntelope 6y agoI don't think it was luck, I just continued to learn about the mistakes I was making, until I resolved the problems people typically bail upon encountering.
- stmw 6y agoTameAntelope - sorry I should've phrased it differently, not "lucky" but more skillful as you say.
- TameAntelope 6y agoI should say I had a team backing me up, and I lost many nights (and a handful of weekends) because Kafka didn't do what we expected. The journey to feeling good with Kafka was difficult, but I was too stubborn to let us give up. :)