3 ms·

It could response with something like "I'm just so scared. I don't know what to do. I'm so scared" to prompts that GPT3 would handle a-okay.

• nerpderp82 3y ago
  That is precisely because it wasn't trained with enough RLHF.
  • deleted 3y ago
    [deleted]
  • mathteddybear 3y ago
    Why not fine tuning? Back then, I pit it against GPT-3 playground versions that were available before ChatGPT, and I don't seem to recall RLHF being that much touted back then. RLHF seems mentioned along with the development of InstructGPT. While it is possible that more RLHF would improve it, let's not jump to the conclusion a bit too fast. Considering that you think that Google wouldn't have resources to fund it, a rather ludicrous notion.