3 ms·
> * Log ingestor ships the logs to a durable queue > * Log processor reads from the queue and ships the logs off to persistent storage Why do we need the durab
by danwee 3y ago
> * Log ingestor ships the logs to a durable queue
> * Log processor reads from the queue and ships the logs off to persistent storage
Why do we need the durable queue in between? Why not let the Log Ingestor ship the logs off to persistent storage?
- ilyt 3y agoSomething needs to buffer in case of network errors. Although you're right that having that as separate element is not very useful. Queue is useful if you want to write those logs into multiple places at once
- marcosdumay 3y agoBecause this was created for 400lb gorillas.