3 ms·
If you can tolerate some data loss, yes. I believe Kafka can still lose some data if all the active machines fail. It's a deliberate design decision (it's the
by justinsb 13y ago
If you can tolerate some data loss, yes.
I believe Kafka can still lose some data if all the active machines fail. It's a deliberate design decision (it's the right thing to do if you want to remain available and can tolerate some data data loss). I believe the Kafka team are working on it, but it's non-trivial to fix.
- ryanbrush 13y agoI believe the ability to configure this behavior is being tracked at the link below. It seems like it's a switch between consistency and availability. By default Kafka prefers availability, and the possible inconsistency results in data loss (because Kafka just discards some inconsistent data it can't resolve). But the JIRA linked below should make that behavior optional, so if a majority of machines fail the cluster will become unavailable rather than inconsistent. https://issues.apache.org/jira/browse/KAFKA-1028 https://issues.apache.org/jira/browse/KAFKA-1028