3 ms·
That's because, based on the training data, the most likely response to asking for directions is to clarify exactly where you are and what you see. But if you
by wavemode 2y ago
That's because, based on the training data, the most likely response to asking for directions is to clarify exactly where you are and what you see.
But if you ask it in terms of a knowledge test ("I'm at the corner of 1st and 2nd, what public park am I standing next to?") a model lacking web search capabilities will confidently hallucinate (unless it's a well-known park).
In fact, my person opinion is that, therein lies the most realistic way to reduce hallucination rates: rather than trying to train models to say "I don't know" (which is not really a trainable thing - models are fundamentally unaware of the limits of their own training data), instead just train them on which kinds of questions warrant a web search and which ones should be answered creatively.
- QuesnayJr 2y agoI tried this just now on Chatbot Arena, and both chatbots asked for more information. One was GPT 4.5 preview, and one was cohort-chowder (which is someone's idea of a cute code name, I assume).
- wavemode 2y agoI tried this just now on Chatbot Arena, and both chatbots very confidently got the name of the park wrong. Perhaps you thought I meant "1st and 2nd" literally? I was just using those as an example so I don't reveal where I live. You should use actual street names that are near a public park, and you can feel free to specify the city and state.