4 ms·
> ChatGPT does not ask for clarification, because it is not a knowledge base trying to find an answer. All it does is figure out what character is statistically
by bentcorner 4y ago
> ChatGPT does not ask for clarification, because it is not a knowledge base trying to find an answer. All it does is figure out what character is statistically most likely to come next, it has no heuristic to know that there is a task it hasn't fully completed.
It absolutely can, but it requires the right prompts. If you just say "give me a diagnosis" it won't, but if you prompt it with a "you are a doctor and I am a patient" kind of prompt, it will.
I'll agree that it tends to "close off" conversations without a lot of open endedness - I role-played through a session using myself as a patient with a chronic condition I suffer from and it correctly identified the problem, but I had to push it a little to get it to try to narrow down the problem (instead of "here's a bunch of things it could be" and ending the convo there).
- colonCapitalDee 4y agoChatGPT's heuristic may lead it to emit a sequence of words that suggest to English speakers that they should provide clarification, but ChatGPT is congenitally incapable of determining that answering a question requires more information that was provided in the prompt and that clarification is needed. Rephrased, ChatGPT can ask for clarification, but only as a side effect of satisfying it's heuristic.
- paradite 4y ago> but ChatGPT is congenitally incapable of determining that answering a question requires more information that was provided in the prompt and that clarification is needed. What's stopping the ChatGPT heuristic / model from determining that? That's within the capabilities of a statistical model.
- Mezzie 4y agoI would say that ChatGPT like systems could probably be built that would understand when they need more context, but they would fail at effectively eliciting that context from their human users.
- PaulDavisThe1st 4y agoI would suggest a read of this ChatGPT transcript (from Twitter today): https://twitter.com/teropa/status/1643641395754745859 https://twitter.com/teropa/status/1643641395754745859
- travisjungroth 4y agoCalling it a "side effect" is really downplaying things. All of its behavior is just satisfying its heuristic. Just did this chat on 3.5. [Me] Boxes that are black with stars have gold inside. Black with circles means silver. Blue with squares means copper and blue with triangles means tin. Your job is to determine the contents of the box. If you need more information, ask for it. Example: User: I have a black box. Assistant: Does it have stars or circles? User: Stars. Assistant: It has gold. I have a blue box. [ChatGPT] Does the blue box have squares or triangles? [Me] Squares [ChatGPT] According to the information you provided, a blue box with squares contains copper. Therefore, the contents of your blue box are copper.
- tjr 4y agoInteresting example. I wonder if it is building a small world model (a la SHRDLU), or if it is answering based on the most statistically likely words, or what.
- dTal 4y agoIt's both - statistically the next word depends on the world model established by the previous words, so it's devoted some of its neurons to that.
- colonCapitalDee 4y ago"A computer can store and operate on data" "That's really downplaying things. My computer can play cat videos"
- travisjungroth 4y agoChange your first line to “a computer is congenitally incapable of providing entertainment. It can provide entertainment, but only as a side effect of storing and operating on data” and it would be more applicable to this exchange.
- l33tman 4y agoYou can ask it to complain if there is a lack of information in the query. You can ask it for what information might be missing. Everything about this is in the prompt and the questions you ask it.. Just asking "what is the diagnosis" leaves out a LOT of context, and what you expect.