Yeah, in my opinion you can just skip that part and go straight to the author's description of failing to train their own model at first and what they ended up

Yeah, in my opinion you can just skip that part and go straight to the author's description of failing to train their own model at first and what they ended up changing to make it work: https://aerial-toothpaste-34a.notion.site/How-OpenAI-Misled-You-on-RLHF-1f83f742d9dd80a68129d06503464aff#24b3f742d9dd80c79798d1602eb252f7 https://aerial-toothpaste-34a.notion.site/How-OpenAI-Misled-...