3 ms·
Are you going to expose your Kafka brokers directly to your integration partners? Are they going to use the Kafka client library and wire protocol to send you d
by closeparen 5y ago
Are you going to expose your Kafka brokers directly to your integration partners? Are they going to use the Kafka client library and wire protocol to send you data? That’s the thing about webhooks, HTTP is universal and if you’re comfortable exposing anything externally, it’s going to be a web service.
- mywittyname 5y agoI would not expose kafka directly. I would implement this as: HTTP Endpoint -> Push to message queue (kafka, SQS, etc) -> Acknowledge receipt That's a pretty straight-forward design that's widely used, robust, and easy to put together. I've probably done that same workflow 100s of times without issue. As long as you guarantee the message was pushed to the queue before acknowledging, that will be fabulously reliable. You need to make contingencies for duplicate messages, but that's not usually difficult.
- mrkurt 5y agoWe expose the NATs protocol to our users. Exposing non-http protocols is fun, sometimes.