3 ms·
There's an SQS/Lamba integration. Push 10k messages in a queue as jobs. The lambdas pull them off and delete them once done. https://cloudonaut.io/integrate-
by tyingq 9y ago
There's an SQS/Lamba integration. Push 10k messages in a queue as jobs. The lambdas pull them off and delete them once done.
https://cloudonaut.io/integrate-sqs-and-lambda-serverless-architecture-for-asynchronous-workloads/ https://cloudonaut.io/integrate-sqs-and-lambda-serverless-ar...
- teej 9y agoFrom what I can tell, this doesn't really help you know when your queued up lambdas have all completed, which is what GP wants.
- tyingq 9y agoYou're right. I assumed the queue depth api call would be useable as a counter. It appears though, that it's only an approximate count unless you use FIFO queues. I guess the individual Lambdas could pop an "I'm done" message onto a FIFO queue. With a single Lambda consumer of that queue that updates an S3 bucket with a count. Done when count == 10,000. That's atomic, and no polling, but feels a bit smelly.