3 ms·
For the records Apache Kafka defines a fairly sophisticated write protocol: request and responses, message formats etc. This is the only way any client interact
by catalepsy 3y ago
For the records Apache Kafka defines a fairly sophisticated write protocol: request and responses, message formats etc. This is the only way any client interacts with a Kafka broker. The Kafka Java library uses that, and so is librdkafka (offering a low level C API). The latter is used by non JVM based clients -- Python Common Lisp: via FFI.
- tombert 3y agoYeah, I knew all that, I've actually used librdkafka. If my goal were as simple "read and write and commit to Kafka", the vanilla clients like rdkafka would be fine. However, most of my personal projects for the last year have made pretty liberal use of the Kafka Streams library, which as far as I'm aware only exists in JVM land.
- jjtheblunt 3y agoSlight topic shift, but did you try https://nats.io https://nats.io and its streaming? We've used it and it worked well.
- tombert 3y agoI have not heard of this. I'll try and play with it tonight or tomorrow, cuz it looks pretty neat.