4 ms·
You're right, I can also reproduce that behavior with the API. Fascinating. I really thought they were the same model but ChatGPT4 is clearly a lot more RLHFd c
by mike_hearn 3y ago
You're right, I can also reproduce that behavior with the API. Fascinating. I really thought they were the same model but ChatGPT4 is clearly a lot more RLHFd compared to the API. Not only is the API honest but it's also way less wordy. Practically every answer from ChatGPT in the sample conversation had to be truncated because it includes an essay about the scientific consensus.
- lucubratory 3y agoThe API model is just as RLHF'd as they disclosed in their 'paper'. The difference you're seeing is very likely to just be the ChatGPT pre-prompt telling it not to engage in harmful activities.