4 ms·
We've already seen it start and they had to actively work against it: https://openai.com/index/where-the-goblins-came-from/ https://openai.com/index/where-the-g
by Izkata 2mo ago
We've already seen it start and they had to actively work against it: https://openai.com/index/where-the-goblins-came-from/ https://openai.com/index/where-the-goblins-came-from/
- sltkr 2mo agoThat article explains that the quirk was introduced during supervised fine-tuning. > We unknowingly gave particularly high rewards for metaphors with creatures It was the human feedback that caused the bias, not a change in training data.