3 ms·
gpt is trained initially on predicting text, then trained with rlhf to make the model more helpful, etc. The second step is referred to as alignment. Rlhf: htt
by tangjurine 4y ago
gpt is trained initially on predicting text, then trained with rlhf to make the model more helpful, etc. The second step is referred to as alignment.
Rlhf: https://huggingface.co/blog/rlhf https://huggingface.co/blog/rlhf