This post was about LLMs so I was specifically referring to LLMs. When I say "they immitate what classification looks like," I don't mean that the classificati

This post was about LLMs so I was specifically referring to LLMs. When I say "they immitate what classification looks like," I don't mean that the classification somehow isn't real, I'm referring to the specific technique of how it's done. If you ask LLM "Is this sentence offensive: ...?", the task that it's doing is not simply "test whether this sentence is offensive." It's something like "generate what a plausible answer to this question looks like," part of which is answering the question (usually). This means that if you ask this question in a way that is more often used with an expectation of a certain answer, LLM will use that as a signal to bias the answer, because "that's how the answers to these questions look like." which is the problem highlighted in the article.