5 ms·
> There is no evidence given that we are seeing more Waluiginess post-RLHF than we did pre-RLHF. Testing with the non-RLHF GPT 3.5 API you could probably figur
by jefftk 4y ago
> There is no evidence given that we are seeing more Waluiginess post-RLHF than we did pre-RLHF.
Testing with the non-RLHF GPT 3.5 API you could probably figure out whether there's more or less Waluiginess, but you're right they post doesn't present this.
- dragonwriter 4y ago> Testing with the non-RLHF GPT 3.5 API There is no such API, though, is there? AFAIK, GPT-3.5-turbo, either the updated or snapshot version, is the RLHF model (but bring your own “system prompt”.)
- jefftk 4y agoGood point! I wonder whether text-davinci-003 is enough to test this?