3 ms·

Not sure what you are expecting. The models are non-deterministic and there is no way to predict hallucinations.

• gmerc 2y ago
  to be fair, a standard model is deterministic at temp==0. And there is a way to predict the presence of hallucinations, but it’s expensive (SelfCheckGPT)
  • threeseed 2y ago
    No. There is no way to consistently predict the presence of hallucinations. It is at best 90% accurate.
    • gmerc 2y ago
      Prediction implies inaccuracy https://arxiv.org/abs/2303.08896 https://arxiv.org/abs/2303.08896