3 ms·
What are SL and RLHF? I would also add it's best not assume others know acronyms like these.
by saberience 4y ago
What are SL and RLHF? I would also add it's best not assume others know acronyms like these.
- cubefox 4y agoSorry. SL = supervised learning. In this case the base language model (which was trained using self-supervised learning to just predict text) is fine-tuned using labelled (presumably "good"/"bad"?) dialogue examples. RL = reinforcement learning. RLHF = reinforcement learning from human feedback. Here human raters reward or punish the model for good/bad dialogue.
- saberience 4y agoThank you! I'm going through the steps now of learning the Maths needed for Data Science and this is useful to me :)