3 ms·
Yeah its low, other papers have seen hallucination rates of 30-40% If I understand this model correctly, its doing it over a curated list of content. I would
by intended 3y ago
Yeah its low, other papers have seen hallucination rates of 30-40%
If I understand this model correctly, its doing it over a curated list of content.
I would say that for this specific test it achieves 97%, and assume a rate of 70%.
Verifying factualness is hard to automate, and all measures are proxies for what an actual human would say.