You can check here for an explanation (with some helpful figures) https://www.assemblyai.com/blog/the-full-story-of-large-language-models-and-rlhf/#rlhf-as-valu

You can check here for an explanation (with some helpful figures) https://www.assemblyai.com/blog/the-full-story-of-large-language-models-and-rlhf/#rlhf-as-value-learning https://www.assemblyai.com/blog/the-full-story-of-large-lang...