"LLMs judged by LLMs" is the industry standard. Can't put a human judge in a box and have him evaluate and rate a set of 7600 responses on demand. Now, are LLM

"LLMs judged by LLMs" is the industry standard. Can't put a human judge in a box and have him evaluate and rate a set of 7600 responses on demand. Now, are LLM judges flawed? Obviously. But they are more shelf stable than humans, so it's easier to compare different results. And as long as you use an LLM judge as a performance thermometer and not a direct optimization target, you aren't going to be facing too many issues from that. If you are using an LLM judge as a direct optimization target though? You'll see some funny things happen. Like GPT-5 prose. Which isn't even the weirdest it gets.