Wow, a whole article that didn't mention the word "sampler" once. There's pretty strong evidence coming out that truncation samplers like min_p and entropix are

Wow, a whole article that didn't mention the word "sampler" once. There's pretty strong evidence coming out that truncation samplers like min_p and entropix are strictly superior to previous samplers (which everyone uses like top_p) to prevent hallucinations and that LLMs usually "know" when they are "hallucinating" based on their logprobs. https://openreview.net/forum?id=FBkpCyujtS https://openreview.net/forum?id=FBkpCyujtS (min_p sampling, note extremely high review scores) https://github.com/xjdr-alt/entropix https://github.com/xjdr-alt/entropix (Entropix) https://artefact2.github.io/llm-sampling/index.xhtml https://artefact2.github.io/llm-sampling/index.xhtml