2 ms·
It seems that the authors were using the "regular" GPT-4 API. The model on the other side of that API has already been fine-tuned to not say that it is a human
by xeckr 3y ago
It seems that the authors were using the "regular" GPT-4 API.
The model on the other side of that API has already been fine-tuned to not say that it is a human or a consciousness being, and I suspect that this fine-tuning interferes with their experiment regardless of the elaborate system prompts the authors supplied to it.
- camrobjones 3y agoThis is a good point. We didn't have any cases of GPT-4 failing to try to pretend to be a human, although GPT-3.5 did this quite frequently. I think RLHF causes other issues though (especially with the tone), and we're interested to try some non-RLHF'd open source models.