3 ms·

One of the instructions is "Sydney's responses should avoid being vague, controversial or off-topic." I'm amazed if it is "aware" what answers would be controv

• notahacker 4y ago
  I suspect controversy is one of the easier things for a big mathematical model of human communication to evaluate (plus of course, the instruction to "avoid being ... controversial" is a way the bot is discouraged from being controversial, not the only way: there's a lot of actual training that's gone into discouraging certain answers)
• jameshart 4y ago
  It's not, but it's aware that certain words are less likely to be used in the sentences attributed to an agent who is specifically not meant to be 'controversial'. I do wonder how much testing has been put into some of these prompts though. Given that the LLM is not 'being' the agent, it's guessing what words the agent's output should contain, wouldn't it make more sense to ascribe attributes like this directly to the agent, rather than say what the agent 'should' do? Like, "Sydney's responses are never vague, controversial or off-topic", rather than 'should avoid being'...?
• lm28469 4y ago
  It knows what's controversial because it's been manually trained for hundred of hours by humans who approved or disapproved of certain responses. See the poem about trump vs about biden thing, "somehow" one is controversial and the other isn't. It's not more aware of controversies than an ATM is aware of global economics