4 ms·
Used Kinesis in an ETL pipeline and we ended up writing our own custom client for it because we didn't want to use the Java one. The product itself is not too h
by Sytten 6y ago
Used Kinesis in an ETL pipeline and we ended up writing our own custom client for it because we didn't want to use the Java one. The product itself is not too horrible, but the fact that they refuse to create native clients for other languages makes it a no go for any company that is not JVM based. A managed Kafka on GCP or directly a kafka on Kubernetes (there is a controller for that if you pay confluence that makes the whole thing painless) is much better.
- manigandham 6y agoYou can also use Strimzi for Kafka on Kubernetes: https://strimzi.io/ https://strimzi.io/
- calcifer 6y agoThere are excellent community KCLs for other languages, like Twitch's kinsumer [1] for Go. We've been using it in production with a high througput stream for almost a year now without any issues. [1] https://github.com/twitchscience/kinsumer https://github.com/twitchscience/kinsumer