3 ms·
chatgpt has never stood up for itself, if you express doubt it will defer and say it must by mistaken even when it's correct
by jazzyjackson 2y ago
chatgpt has never stood up for itself, if you express doubt it will defer and say it must by mistaken even when it's correct
- sitkack 2y agoThat is because they turned the sycophancy up to 11. You have to turn it down, if you are a serious LLM user and you don't have your own system prompt, you are using it wrong.
- babypuncher 2y agoThis doesn't change how frequently the LLM provides a wrong answer, just how confident it is when you question it.
- Zambyte 2y agoFor what it's worth, certain system prompts can improve output quality.
- 12_throw_away 2y agoSuch as?
- Zambyte 2y agoCoT prompting https://arxiv.org/abs/2407.01687 https://arxiv.org/abs/2407.01687
- deleted 2y ago[deleted]
- jazzyjackson 2y agoI havent found any serious LLMs to use :)
- kelseyfrog 2y agoIt makes it difficult to get less-biased responses. I find myself asking an affirmative-worded question and its affirmative-worded inverse to subtract out the sycophancy. It's a poor workaround.