2 ms·
RLHF is fine tuning :)
by whimsicalism 4y ago
RLHF is fine tuning :)
- int_19h 4y agoYou're right, my apologies. What I meant is that specifically in ChatGPT context they have been always talking about RHLF as separate from fine-tuning on preassembled training data. As I understand, they use the latter mainly to get the desired behavior as a chatbot "eager" to answer questions and solve tasks. And then RLHF is what "puts the smiley face on top", so that it refuses to answer some questions, or gives "aligned" answers. The pronoun would be in that category.
- whimsicalism 4y agoMy bet is that they use the pre-assembled training data to train the reward LLM and maybe also for fine tuning the model in addition to RLHF. This is my best guess, afaik the research is pretty opaque right now.