4 ms·

I've been following this project for a long time, but I have to ask what are the advantages over using Kafka Connect Sinks? https://docs.confluent.io/current/c

• mooreds 7y ago
  Looks like the S3 connector was released in 2017. So if you wanted this functionality before then, secor was a good option: https://www.confluent.io/blog/apache-kafka-to-amazon-s3-exactly-once https://www.confluent.io/blog/apache-kafka-to-amazon-s3-exac... It also supports going to other cloud object stores (other than S3).
  • chrisjc 7y ago
    Yup, there was definitely a reason to consider Secor before 2017. Part of the reason I'm familiar with Secor in the first place. Just to be clear, there are dozens of Kafka Connect Sinks and Sources, and finding Kafka Connect Sinks for other blob storage solutions should be easy. If you can't the KC framework makes it pretty easy to develop your own.
• memorythought 7y ago
  I don't think there's a good connect sink for GCS available under a non commercial license
  • chrisjc 7y ago
    https://docs.confluent.io/current/connect/kafka-connect-gcs/index.html https://docs.confluent.io/current/connect/kafka-connect-gcs/... > You can use this connector for a 30-day trial period without a license key. Ugh, you're right...