5 ms·
ChatGPT is distinguishable from a human, because ChatGPT never responds "I don't know.", at least not yet. :)
by NoOn3 3y ago
ChatGPT is distinguishable from a human, because ChatGPT never responds "I don't know.", at least not yet. :)
- ben_w 3y agoIt can do: https://chat.openai.com/share/f1c0726f-294d-447d-a3b3-f664dcc74de4 https://chat.openai.com/share/f1c0726f-294d-447d-a3b3-f664dc... IMO the main reason it's distinguishable is because it keeps explicitly telling you it's an AI.
- rezonant 3y agoThis isn't the same thing. This is a commanded recital of a lack of capability, not that its confidence in it's answer is low. For a type of question the GPT _could_ answer, most of the time it _will_ answer, regardless of accuracy
- NoOn3 3y agoI just noticed that when I ask really difficult technical questions, but for which there is an exact answer, It often tries to answer plausibly, but incorrectly instead of answering "I don't know". But over time, It becomes smarter and there are fewer and fewer such questions...
- ben_w 3y agoHave you tried setting a custom instruction in settings? I find that setting helps, albeit with weaker impact than the prompt itself.
- NoOn3 3y agoIt's not a problem for me. It's good that I can detect chatGPT by this sign.
- daveguy 3y agoIt doesn't become smarter except for releases of new models. It's an inference engine.
- peignoir 3y agoI read an article where they did a proper Turing test and it seems people recognize it was a machine answering because it made no writing errors and wrote perfectly
- ben_w 3y agoI've not read that, but I do remember hearing that the first human to fail the Turing test did so because they seemed to know far too much minutiae about Star Trek.
- NoOn3 3y agoMaybe It's because It was never rewarded for such answers when It was learning.
- epolanski 3y agoOf course it does.
- raccoonDivider 3y agoSome humans also never respond "I don't know" even when they don't know. I know people who out-hallucinate LLMs when pressed to think rigorously
- int_19h 3y agoIt absolutely does that (GPT-4 especially), and I have hit it many times in regular conversations without specifically asking for it.