I think it's rather crude and inefficient to generate several translations with a prompt. Can't we just sample different "branches" of successive tokens with s

I think it's rather crude and inefficient to generate several translations with a prompt. Can't we just sample different "branches" of successive tokens with some mechanism for ensuring diversity like [1] did? This would allow the user to edit a handful of words/phrases/sentences and guide the LLM towards a more idiomatic translation. This may even give smaller local models a chance. [1] https://suricrasia.online/blog/making-amulets-with-llama/ https://suricrasia.online/blog/making-amulets-with-llama/