3 ms·
The min_p paper and many other papers are doing exactly that.
by Der_Einzige 2y ago
The min_p paper and many other papers are doing exactly that.
- NitpickLawyer 2y agoIs this [1] the paper you're referring to? Unless I'm reading Table2 (page7 - pdf version) wrong, on math, min_p is shown to score worse than top_p. For temp 0.7 it scores 1 point lower than top_p. And from temps 1.0 and up, while scoring higher than top_p for the same temp, it scores way lower (6points and up) than top_p at 0.7. So overall, if you want accurate answers (and for math you kinda do), min_p is worse overall? Unless I miss-understand something. I agree with the authors that if you want a tradeoff between accuracy and diversity, min_p might help, but if you're looking for precise answers, the results will be slightly worse. It's a tradeoff, but as I said above, people often fail to mention it as such, and instead proclaim it to be "better" across the board. [1] - https://arxiv.org/pdf/2407.01082 https://arxiv.org/pdf/2407.01082
- deleted 2y ago[deleted]