Are they measuring conformance to the system prompt for reinforcement? It seems to me that you could break this system prompt down statement by statement and u

Are they measuring conformance to the system prompt for reinforcement? It seems to me that you could break this system prompt down statement by statement and use a cheap LLM to compare responses to each one in turn. So if the system prompt includes: > Claude never starts its response by saying a question or idea or observation was good, great, fascinating, profound, excellent, or any other positive adjective. It skips the flattery and responds directly. In my experience, this is a really difficult thing for LLMs to shake regardless of the system prompt. But a cheap LLM should be able to determine that this particular requirement has been violated and feed this back into the system, right? Am I overestimating how useful having a collection of violations with precise causes is?