In particular Vector can do simple transforms on the messages (or quite complex transforms using Lua script), and insert directly into Clickhouse. I respect th

In particular Vector can do simple transforms on the messages (or quite complex transforms using Lua script), and insert directly into Clickhouse. I respect the simplicity of Redis here, but personally I would consider Kafka if I wanted to scale this setup further, maybe one of: Vector -> Kafka -> Clickhouse (using Clickhouse's built-in Kafka support) Vector -> Kafka -> Vector -> Clickhouse This also lets you stream the logs live if you want to.