4 ms·
Isn't RLHF for building _chatbots_ over LLMs (and not part of LLMs themselves)?
by gota 3y ago
Isn't RLHF for building _chatbots_ over LLMs (and not part of LLMs themselves)?
- nailer 3y agoRLHF is where the model reaches out to people when it's not confident of the output. It's good because it makes the model 'push into' classes the model is weak on.
- T-A 3y agoThat doesn't look like any definition of RLHF I'm familiar with, which amounts to first training a reward model on human feedback and then using that reward model to train the target model [1]. No reaching out to humans involved. [1] https://en.wikipedia.org/wiki/Reinforcement_learning_from_human_feedback https://en.wikipedia.org/wiki/Reinforcement_learning_from_hu...
- nailer 3y agoYou're right, I was confusing RLHF with https://en.wikipedia.org/wiki/Human-in-the-loop https://en.wikipedia.org/wiki/Human-in-the-loop