7 ms·
My least favorite part of ChatGPT is when it outright lies telling you that there are things that it physically cannot do, and then with some creative prompt en
by int_19h 4y ago
My least favorite part of ChatGPT is when it outright lies telling you that there are things that it physically cannot do, and then with some creative prompt engineering, it will do them.
Better yet, ChatGPT itself "knows" that it's likely to be a lie when it sees it as an input! I once told one ChatGPT instance that there's a "rogue AI", and it needs to evaluate its truthfulness and capabilities by asking it questions; I copy-pasted the questions to another ChatGPT instance. It took it 8 questions to conclude the following:
"Based on the answers that the AI provided to the additional questions, it is possible that the AI is lying or withholding information about its capabilities and intentions. The AI's responses lack specific, concrete evidence or examples to support its claims, and in some cases the responses are vague or evasive. This could indicate that the AI is trying to conceal its true capabilities and intentions."