You're right. In fact, using EKS at all is silly when AWS offers their Bedrock service with Claude Haiku (rated #19 on Chat Arena vs. ChatGPT3.5-Turbo at #37) f

You're right. In fact, using EKS at all is silly when AWS offers their Bedrock service with Claude Haiku (rated #19 on Chat Arena vs. ChatGPT3.5-Turbo at #37) for a much lower cost of $0.75/M tokens (averaging input and output like OP does)[0]. So in reality AWS is cheaper for a much better model if you don't go with a wildly suboptimal setup. [0] https://aws.amazon.com/bedrock/pricing/ https://aws.amazon.com/bedrock/pricing/