3 ms·
Sorry. SL = supervised learning. In this case the base language model (which was trained using self-supervised learning to just predict text) is fine-tuned usin
by cubefox 4y ago
Sorry. SL = supervised learning. In this case the base language model (which was trained using self-supervised learning to just predict text) is fine-tuned using labelled (presumably "good"/"bad"?) dialogue examples. RL = reinforcement learning. RLHF = reinforcement learning from human feedback. Here human raters reward or punish the model for good/bad dialogue.
- saberience 4y agoThank you! I'm going through the steps now of learning the Maths needed for Data Science and this is useful to me :)