2 ms·
> could at least tell you when they're making something up themselves where Bing/Bard seemingly cannot. In fact GPT-4 is quite good at catching hallucinations
by smallnamespace 4y ago
> could at least tell you when they're making something up themselves where Bing/Bard seemingly cannot.
In fact GPT-4 is quite good at catching hallucinations when the question-answer pair is fed back to itself.
This isn’t automatically applied already because the model is expensive to run, but you can just do it yourself (or automate it with a plug-in or LangChain) and pay the extra cost.
Remember that the model only performs a fixed amount of computation per generated token, so just asking it to think out loud or evaluate its own responses is basically giving it a scratchpad to think harder about your question.