Hallucination is creativity when you don't want it. Creativity is hallucination when you do want it. A lot of the "reduction" of hallucination is management o

Hallucination is creativity when you don't want it. Creativity is hallucination when you do want it. A lot of the "reduction" of hallucination is management of logprobs, of which fancy samplers like min_p do more to improve LLM performance than most, despite no one in the VC world knowing or caring about this technique. If you don't believe me, you should check out how radically different an LLMs outputs are with even slightly different sampling settings: https://artefact2.github.io/llm-sampling/index.xhtml https://artefact2.github.io/llm-sampling/index.xhtml