4 ms·
This is a difficult UI design challenge, but not an impossible one. I think ChatGPT needs to start returning contextual tips alongside responses that might suf
by simonw 3y ago
This is a difficult UI design challenge, but not an impossible one.
I think ChatGPT needs to start returning contextual tips alongside responses that might suffer from some of these problems.
I made a mockup of that a while ago: https://twitter.com/simonw/status/1641467385688489984 https://twitter.com/simonw/status/1641467385688489984
UPDATE: I blogged better mockups here: https://simonwillison.net/2023/May/30/chatgpt-inline-tips/ https://simonwillison.net/2023/May/30/chatgpt-inline-tips/
To save you the click: the user asks for what's trending on pinterest, and ChatGPT (in my mockup) shows a little inline warning note with a warning icon that says: "My data is only accurate up to September 2021 and I am unable to access or search the internet for more recent information."
I need to re-make that mockup because I don't like the way it says "My data ..." - I think it should say "ChatGPT's data ..." instead.
- NelsonMinar 3y agoIt is hard and clearly the blanket disclaimer isn't working well enough! I think what would work best is specific annotations tagged onto assertions of facts that might not be correct. When ChatGPT spits out what looks like a journal article citation, put a note on it that says "you should verify this article exists". Maybe that's the hard part though, detecting in the software when ChatGPT might be making something up.
- csense 3y ago> detecting in the software when ChatGPT might be making something up Grammatically speaking, is this statement an assertion of fact? If so, annotate it. It's probably not that hard to implement this (we've had grammar checkers for ages). Of course then if you ask ChatGPT about anything, basically every single sentence that says something useful is annotated with your "Hallucination warning" and either (1) people dismiss your AI as useless and your business is in peril because you have trouble finding customers / investors, or (2) they start ignoring it, because the alternative is doing your own research, and the reason they're using your AI in the first place is as a shortcut to avoid that.
- heliophobicdude 3y agoThis is great! Addressing the model limitations a bit: in the demonstration data that is provided to the base model, we should prevent computed or "looked up" answers. I've seen some of the demonstration data that people are using to train instruction-tuned models and are being taught to respond by making up answers to solutions it shouldn't try to compute. Btw, the output is wrong. { "instruction": "What would be the output of the following JavaScript snippet?", "input": "let area = 6 * 5;\nlet radius = area / 3.14;", "output": "The output of the JavaScript snippet is the radius, which is 1.91." }, [1] The UI note for now would get us very far but by filtering out demonstrations that retrieve or compute information we can go even farther. Symbol tuning [2] is addressing the quality of demonstrations but we can take it further by removing retrievals and computations altogether. Bonus: we can demonstrate how to make it respond so that the user/agent be informed of how to compute or retrieve. 1: https://github.com/sahil280114/codealpaca/commit/0d265112c705f88848783dfdf9bdca9df64d8e35#diff-0585315a2292ca9c3186c41e52ce9427a39b5f595d4bee6aae15e9443c95051b https://github.com/sahil280114/codealpaca/commit/0d265112c70... 2: https://arxiv.org/abs/2305.08298 https://arxiv.org/abs/2305.08298
- pdonis 3y ago> the user asks for what's trending on pinterest, and ChatGPT (in my mockup) shows a little inline warning note with a warning icon that says: "My data is only accurate up to September 2021 and I am unable to access or search the internet for more recent information." But that doesn't address the actual root cause of why ChatGPT is not reliable: that ChatGPT does not actually check anything. If you ask ChatGPT for what's trending on pinterest, not only does it not go check pinterest for what's trending now, it doesn't even go check its training data for pinterest posts to see what was trending as of the latest date in its training data. It just confabulates a response based on the word frequencies in its training data. It literally has no concept of "checking what it says", not even against its own data.
- simonw 3y agoSure, in an ideal world OpenAI would solve that problem instead. It's pretty clear at this point that solving that is really astonishingly difficult - so I'm suggesting a UI band-aid.
- pdonis 3y ago> I'm suggesting a UI band-aid. But what you're suggesting doesn't look like a "band-aid" to me. It looks like more of the same misleading information that ChatGPT's creators have been giving. Your UI message implies that ChatGPT is checking actual pinterest posts for the time period that's included in the training data; but it isn't.