4 ms·
I have a love/hate relationship with AWS's Kinesis Client Library. In one of our implementations, we use the `amazon_kcl_helper.py` script (python) to download
by phamilton 3y ago
I have a love/hate relationship with AWS's Kinesis Client Library.
In one of our implementations, we use the `amazon_kcl_helper.py` script (python) to download and configure the KCL Multilang Daemon (a java application) which calls out to our application (a golang binary) via STDIN/STDOUT.
And honestly, it's fine. The Multilang Daemon manages shard ownership, spins up one binary per shard, fetches records, passes them to the binary, updates checkpoints, etc. Our binary just focuses on our actual application logic. And the python script does a good job of setting everything up.
It just feels wild to involve all three.