4 ms·
Cool, Hope it can give an alterantive to Debezium. I never liked Debezium how it first must copy the whole CDC state to kafka. And you must set the kafka retn
by scirob 2y ago
Cool, Hope it can give an alterantive to Debezium. I never liked Debezium how it first must copy the whole CDC state to kafka. And you must set the kafka retnetion time to infinity, which many kafka as a service systems don't allow anyway.
- FridgeSeal 2y ago> how it first must copy the whole CDC state to kafka There’s a setting that controls whether it will do a snapshot first. Turn it off and it will just start sending through new cdc entries. > you must set the kafka retention time to infinity Is this a new retirement? I’ve never had to do this.
- jitl 2y agoI recently set up a Debezium / Kafka Connect cluster and didn’t need to do either of these things. I have some topics with 7 day retention, and some with 0 second retention. No full scan at all, not necessary for my use case.