4 ms·
Do you find that you have to replay data often? I'd imagine that 99% or more of that 400GB/day gets thrown away before ending up in Redshift.
by connormcarthur 9y ago
Do you find that you have to replay data often?
I'd imagine that 99% or more of that 400GB/day gets thrown away before ending up in Redshift.
- odammit 9y agoRarely. We visualize a lot of it in Kibana and our kibana indexes are pruned after N days (configured for each event type). We usually only replay when we want to restore data for querying stuff outside the pruning range. We keep all that data forever.