4 ms·
To think that Trenton invented a far better LLM sampler than top_p/top_k back in 2019 (tail free sampling - https://www.trentonbricken.com/Tail-Free-Sampling/ h
by Der_Einzige 1y ago
To think that Trenton invented a far better LLM sampler than top_p/top_k back in 2019 (tail free sampling - https://www.trentonbricken.com/Tail-Free-Sampling/ https://www.trentonbricken.com/Tail-Free-Sampling/) and it and pretty much all other better samplers are still not being used in production in 2025.
Trenton please if you are listening give us an explanation for this!
- zackangelo 1y agoAre you familiar with min_p sampling? Kind of funny that it was introduced randomly on Reddit a couple of years ago instead of in a journal or something[0]. But I believe it's widely implemented and used now. [0] https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/ https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_se...
- Der_Einzige 1y agoI'm one of the authors on the paper about min_p sampling :)