3 ms·
StreamX is a kafka-connect based connector to copy data from Kafka to Object Stores like Amazon s3, Google Cloud Storage and Azure Blob Store Skills : Java, Un
by code_champ1 10y ago
StreamX is a kafka-connect based connector to copy data from Kafka to Object Stores like Amazon s3, Google Cloud Storage and Azure Blob Store
Skills : Java, Understanding Kafka, Cloud Object Stores (s3/GCS/Azure blob store)
https://github.com/qubole/streamx https://github.com/qubole/streamx
License : Apache V2
Currently, this has support only for s3. We want to add support for other cloud object stores. Also, we would like to support different output formats(ORC to start with). Feel free to create issues and we can discuss there.
For any more details, mail praveen.seluka@gmail.com