They’ve recently added this functionality to AWS Bedrock thankfully. Doesn’t support OpenAI models, but does support Anthropic. https://aws.amazon.com/about-aw

They’ve recently added this functionality to AWS Bedrock thankfully. Doesn’t support OpenAI models, but does support Anthropic. https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-bedrock-batch-inference/ https://aws.amazon.com/about-aws/whats-new/2023/11/amazon-be...