3 ms·
> there isn't a "I don't have enough information" option. This is due to the fact that LLMs are basically just giant look up maps with interpolation. Have you
by throw310822 2y ago
> there isn't a "I don't have enough information" option. This is due to the fact that LLMs are basically just giant look up maps with interpolation.
Have you ever tried telling ChatGPT that you're "in the city centre" and asking it if you need to turn left or right to reach some landmark? It will not answer with the average of the directions given to everybody who asked the question before, it will answer asking you to tell it where you are precisely and which way you are facing.
- wavemode 2y agoThat's because, based on the training data, the most likely response to asking for directions is to clarify exactly where you are and what you see. But if you ask it in terms of a knowledge test ("I'm at the corner of 1st and 2nd, what public park am I standing next to?") a model lacking web search capabilities will confidently hallucinate (unless it's a well-known park). In fact, my person opinion is that, therein lies the most realistic way to reduce hallucination rates: rather than trying to train models to say "I don't know" (which is not really a trainable thing - models are fundamentally unaware of the limits of their own training data), instead just train them on which kinds of questions warrant a web search and which ones should be answered creatively.
- QuesnayJr 2y agoI tried this just now on Chatbot Arena, and both chatbots asked for more information. One was GPT 4.5 preview, and one was cohort-chowder (which is someone's idea of a cute code name, I assume).
- wavemode 2y agoI tried this just now on Chatbot Arena, and both chatbots very confidently got the name of the park wrong. Perhaps you thought I meant "1st and 2nd" literally? I was just using those as an example so I don't reveal where I live. You should use actual street names that are near a public park, and you can feel free to specify the city and state.