4 ms·
Queues are great as a buffer to even out compute utilization. With an empty queue, most workers can be shut down after a while, saving on compute cost. When the
by ww520 4y ago
Queues are great as a buffer to even out compute utilization. With an empty queue, most workers can be shut down after a while, saving on compute cost. When the queue grows and stays non-empty, more workers can be started up. The length of the queue can be used to estimate the number of workers to spin up, as a metric for real time capacity planning.