I really recommend people study the measurement frailties and prompting sensitivities of LLM judges before employing them. They're valuable, but should be used

I really recommend people study the measurement frailties and prompting sensitivities of LLM judges before employing them. They're valuable, but should be used with complete understanding of the risks: https://www.cip.org/blog/llm-judges-are-unreliable https://www.cip.org/blog/llm-judges-are-unreliable