I think serverless could be the right fit, something like detectors seems ideal. Theyre somewhat isolated individually, etc etc. I kind of want to take a Crack

I think serverless could be the right fit, something like detectors seems ideal. Theyre somewhat isolated individually, etc etc. I kind of want to take a Crack at what Prime Video did except serverless from a green field perspective, and I'm willing to bet I wind up provisioning a RedPanda cluster or similar and having them feed detector lambdas. The bottleneck and cost here appeared to be storing intermediate results and the orchestration. Orchestration is solved by using something like SQS or what have you. Intermediate results are somewhat harder depending on size - but I think you could get there and it'd be an interesting exercise.