3 ms·
Log compaction is generally what you want, which will preserve the most recent message for every key in a topic. Event streams expanding boundlessly is somethin
by snuxoll 9y ago
Log compaction is generally what you want, which will preserve the most recent message for every key in a topic. Event streams expanding boundlessly is something very few will ever need or want, so you'll toss messages into an "event" topic of some kind, apply the event to the most recent entry in the "model" topic and store a new version (which will be kept after log compaction, the original messages can be pruned after you need to free up storage).