3 ms·
> Honestly the absolute revolution for me would be if someone managed to make LLM tell "sorry I don't know enough about the topic" https://arxiv.org/abs/2509.0
by xmcqdpt2 9mo ago
> Honestly the absolute revolution for me would be if someone managed to make LLM tell "sorry I don't know enough about the topic"
https://arxiv.org/abs/2509.04664 https://arxiv.org/abs/2509.04664
According to that OpenAI paper, models hallucinate in part because they are optimized on benchmarks that involve guessing. If you make a model that refuses to answer when unsure, you will not get SOTA performance on existing benchmarks and everyone will discount your work. If you create a new benchmark that penalizes guessing, everyone will think you are just creating benchmarks that advantage yourself.
- cbdevidal 9mo agoHoly perverse incentives, Batman
- KellyCriterion 9mo ago...or they hallicunate because of floating point issues in parallel execution environments: https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/ https://thinkingmachines.ai/blog/defeating-nondeterminism-in...
- snovv_crash 9mo agoThat is such a cop-out, if there was a really good benchmark for getting rid of hallucinations then it would be included in every eval comparison graph. The real reason is that every bench I've seen has Anthropic with lower hallucinations.