We already do beam search, which allows LLMs to backtrack on branches until they find the highest probability path. Discounting things like Toolformer, this is

We already do beam search, which allows LLMs to backtrack on branches until they find the highest probability path. Discounting things like Toolformer, this is about as good as it's going to get.