I’ve also seen that GPTs struggle to admit when they dont know. I wrote up an approach for evaluating that here - http://blog.pamelafox.org/2024/03/evaluating-r

I’ve also seen that GPTs struggle to admit when they dont know. I wrote up an approach for evaluating that here - http://blog.pamelafox.org/2024/03/evaluating-rag-chat-apps-can-your-app.html?m=1 http://blog.pamelafox.org/2024/03/evaluating-rag-chat-apps-c... Changing the prompt didn't help, but moving to GPT-4 did help a bit.