2 ms·
> Downside is customers have to maintain their own offsets (in some storage) Minor correction: you can maintain the offsets yourself if you want, but usually i
by teraflop 3y ago
> Downside is customers have to maintain their own offsets (in some storage)
Minor correction: you can maintain the offsets yourself if you want, but usually it's not necessary because Kafka can do it for you.
The abstraction Kafka provides is that for each consumer group and for each (topic, partition) tuple, your consumer object that is guaranteed not to receive messages before the last offset at which you called commit(). Internally, the committed offsets are stored in a special Kafka topic of their own.
- flashgordon 3y agoAh is this offset maintained by the Kafka client? (I included that as "client" as well). I thought the Kafka topic itself did not maintian any client specific offsets (how could it)? Unless this was added in recent years. Interesting tho!