4 ms·
How is Bing Chat citing sources with links not a plan to address the hallucination problem? It’s not a perfect mitigation, but surely it’s at least one step ab
by brookst 4y ago
How is Bing Chat citing sources with links not a plan to address the hallucination problem?
It’s not a perfect mitigation, but surely it’s at least one step above “no plan”.
- PaulDavisThe1st 4y agoFirst of all, the "citing sources" needs to be out-of-band from the regular response, since we've already seen that these systems are entirely comfortable inventing ficticious sources. Second, if I give you a wonderfully written paragraph or two about the history of the British Parliament, and 3 links that supposedly back me up, how likely are you to check the links? Because that's what is actually going to happen. The LM will not "cite" a source, it will provide one out-of-band and your motivation to read it will need to be high, which is unlikely given the apparent quality of the LM's own answer.
- brookst 4y agoYou seem to be talking about chatgpt, not bing chat. Bing chat literally uses the search engine queries and links to those sources. I have seen its summaries include mistakes, but I have never seen it invent sources (I’ve tried maybe 500 chat queries). It’s ironic that you’re very confidently presenting erroneous information here. I’d really recommend trying the actual product, or at least looking at the demos. It has some problems. It does not have the same problems that chatgpt does, because it does not rely solely on LLM baked-in data.