2 ms·
This is new for me. How does ChatGPT use RL? I'm talking about RL in the sense of interacting with an environment during training. Isn't GPT trained by predict
by amelius 4y ago
This is new for me. How does ChatGPT use RL?
I'm talking about RL in the sense of interacting with an environment during training. Isn't GPT trained by predicting the next word in a large but static piece of text?
- amelius 4y agoUpdate: ok, I found an explanation here: https://huggingface.co/blog/rlhf https://huggingface.co/blog/rlhf