2 ms·
> If the queue is not empty, it means that whatever job is consuming from the queue is not keeping up with messages coming into it. You could conceivably have
by plandis 4y ago
> If the queue is not empty, it means that whatever job is consuming from the queue is not keeping up with messages coming into it.
You could conceivably have a non-zero queue size that asymptotically reaches some stable size over time. In such a case you are keeping up with messages but with some approximately static amount of added latency.
I don’t think I’ve seen this happen in practice but I think some systems can be engineered to be approximately stable (grows and shrinks but within predictable bounds)
- remram 4y agoThis is very common when you can adjust the consume rate. This happens in practice: serverless platforms scale, Kubernetes has HorizontalPodAutoscaler, you can manually grab more VMs, or IRL this might mean calling in more staff or at larger time scales hiring more people in your organization.