2 ms·
I had a simple one on a Kubernetes cluster in AWS. What happened is we'd have a queue processor that normally needed a couple of pods to handle events. Except
by slyall 2y ago
I had a simple one on a Kubernetes cluster in AWS.
What happened is we'd have a queue processor that normally needed a couple of pods to handle events. Except that once a day another process would drop in 5 million requests into the queue.
So I just had a simple keda autoscaler based on the length of the queue. One pod for every 10,000 items in the queue with a minimum of 2 pods and a maximum of 50 pods.
It would scale up after the big queue dumps, chew threw the backlog and then scale back down again.
- John23832 2y agoKeda was really good. I just wish that they had actually developed an http scaler. Having to use Knative scaling as an alternative is a pain.