5 ms·

Wait, is that true? I feel like that claim needs a lot of disclaimers.

• famouswaffles 3y ago
  https://arxiv.org/abs/2305.18248 https://arxiv.org/abs/2305.18248 "In particular, we find that LMs often hallucinate differing authors of hallucinated references when queried in independent sessions, while consistently identify authors of real references. This suggests that the hallucination may be more a generation issue than inherent to current training techniques or representation." https://arxiv.org/abs/2303.08896 https://arxiv.org/abs/2303.08896 "SelfCheckGPT leverages the simple idea that if a LLM has knowledge of a given concept, sampled responses are likely to be similar and contain consistent facts. However, for hallucinated facts, stochastically sampled responses are likely to diverge and contradict one another."