Your comment makes sense but I'm pretty sure yreg is saying the opposite of that—that their task is harder than the benchmark currently is. (see their follow-u

Your comment makes sense but I'm pretty sure yreg is saying the opposite of that—that their task is harder than the benchmark currently is. (see their follow-up reply: "The cheapest-per-benchmark-task model would be useless to me if it cannot do the task I need.") In either case, you need the right benchmark for the right task