3 ms·
> There's not really any reason to think this other than shibboleths, it's become a thought-deadening cliche. The official OpenAI GPT-4 paper specifically repo
by gwern 3y ago
> There's not really any reason to think this other than shibboleths, it's become a thought-deadening cliche.
The official OpenAI GPT-4 paper specifically reporting that the RLHF model is badly uncalibrated, while the GPT-4 base mode is pretty well calibrated, is a good reason to think that, and is not a 'thought-deadening cliche shibboleth': https://arxiv.org/pdf/2303.08774.pdf#page=12 https://arxiv.org/pdf/2303.08774.pdf#page=12 "The post-training hurts calibration significantly."
- refulgentis 3y agoFascinating - thank you!!