4 ms·
I made a similar comment when streams were first announced, but didn't get feedback. My question is about using streams for event-sourcing, in similar cases to
by ralusek 8y ago
I made a similar comment when streams were first announced, but didn't get feedback.
My question is about using streams for event-sourcing, in similar cases to how Kafka is frequently used. In such cases, the expectation for persistence is paramount, as the event log is ultimately the primary source of truth for the entire application. The actual utility of having the event log in memory is only really important while the consumer groups are reading it, after which it mostly just needs to be archived.
So my question is, are the common strategies used by Redis to persist to disk going to try to keep the whole event log in memory, or will they be able to intelligently offload to disk? Otherwise, is the expectation that clients will instead write to the stream, and consumers will be responsible for consuming, writing to some persistent layer like s3, and then removing from the stream?
- antirez 8y agoHello ralusek, the idea is to provide more the tools for the application layer to move data from/to stream. I don't think we'll have direct support for persisting streams on disk. Honestly streams as implemented in Redis are very adapt to this use case, because of the macro-nodes that are swappable as a single entity, however some time ago I decided that I wanted to focus on the on-memory aspect.
- ralusek 8y agoCool, thank you for response.