4 ms·
The discrepancy between the two answers regarding the set of coins is jarring. From the answer to the first question, one would assume that it can’t tell the cu
by layer8 3y ago
The discrepancy between the two answers regarding the set of coins is jarring. From the answer to the first question, one would assume that it can’t tell the currency. The answer to the second question shows that it actually can. The fact that LLMs don’t reflect a consistent inner model in that way, and hence the users’ inability to adequately reason about their AI interlocutor, is currently a severe usability issue.
- zwily 3y agoI’ve gotten in the habit of asking chatgpt “are you sure?” So many times it will (correctly) correct itself, state that items are hallucinations, etc. It always makes me laugh.
- famouswaffles 3y ago>The fact that LLMs don’t reflect a consistent inner model in that way You're probably not going to ask any human a question about an image and get every single detail you want every time. If you care about a detail, just ask about it. Doesn't really have anything to do with a consistent inner model.
- Workaccount2 3y agoI've heard that it is because the AI outputs what it is thinking as it is thinking it. It doesn't really reflect, it sort of does the equivalent of just verbal thought streaming right onto the screen. So when you ask it to reflect on what it said, that's when it actually looks at it and reflects on it.