Generally, if you've got a task big enough that you're worried about pricing, it's probably going to involve thousands of API calls. In that case you might as

Generally, if you've got a task big enough that you're worried about pricing, it's probably going to involve thousands of API calls. In that case you might as well make ~20 API calls to each LLM under consideration, and evaluate the results yourself. It's far easier to evaluate a model's performance on a given prompt by looking at the output than by looking at the input alone.