> Any code that is written to "sanitize" an input will either need to be less "intelligent" than gpt3 or at least as intelligent. So use GPT-3 itself to rate i

> Any code that is written to "sanitize" an input will either need to be less "intelligent" than gpt3 or at least as intelligent. So use GPT-3 itself to rate its own answer. You need to format the prompt examples to contain the self-rating, then the model will imitate the prompt and self-rate its own answer, but you need to train that function with some labelled data like InstructGPT. There have been a number of applications - step-by-step reasoning, declining to answer nonsensical or unknown facts, declining sensitive topics, answer bias estimation (like gender bias) - they all rely on the language model itself to generate its own evaluation, we could say they are a meta-reasoning application of LMs. Fortunately it is straightforward to have LMs reason about their own internal states, it's no different from regular usage.