3 ms·

RLHF is where the model reaches out to people when it's not confident of the output. It's good because it makes the model 'push into' classes the model is weak

• T-A 3y ago
  That doesn't look like any definition of RLHF I'm familiar with, which amounts to first training a reward model on human feedback and then using that reward model to train the target model [1]. No reaching out to humans involved. [1] https://en.wikipedia.org/wiki/Reinforcement_learning_from_human_feedback https://en.wikipedia.org/wiki/Reinforcement_learning_from_hu...
  • nailer 3y ago
    You're right, I was confusing RLHF with https://en.wikipedia.org/wiki/Human-in-the-loop https://en.wikipedia.org/wiki/Human-in-the-loop