3 ms·
Besides beam search and it's variants? (there are many including the little known but awesomely powerful constrained beam search: https://huggingface.co/blog/co
by Der_Einzige 1y ago
Besides beam search and it's variants? (there are many including the little known but awesomely powerful constrained beam search: https://huggingface.co/blog/constrained-beam-search https://huggingface.co/blog/constrained-beam-search)
Does MBR (minimal bayes risk) sampling count?
Also there was this paper at ICLR which is relevant to this question: https://arxiv.org/abs/2410.03968 https://arxiv.org/abs/2410.03968
This paper basically claims that non-heuristic methods (like beam search) are harmful compared to the heuristic ones.