2 ms·
Do you store raw data ingested from Kafka directly in S3 or have an intermediate database for hot data?
by hopel 11y ago
Do you store raw data ingested from Kafka directly in S3 or have an intermediate database for hot data?
- paladin314159 11y agoThe raw data is stored directly into S3 every hour, but there are multiple systems that process the data directly from Kafka in order to produce the real-time pre-aggregated views.