I’ve wondered about the same point for a long time. In smaller language models of chemistry the tree search in decoding has made a huge difference [1]. If the t

I’ve wondered about the same point for a long time. In smaller language models of chemistry the tree search in decoding has made a huge difference [1]. If the training data set doesn’t include the right conditioning it may be hard for the LLM to learn to associate high probability answers with more useful answers, however, this seems like a solvable problem for many subdomains. [1] search for branch-and-bound in: https://pubs.acs.org/doi/10.1021/acs.jcim.0c00321 https://pubs.acs.org/doi/10.1021/acs.jcim.0c00321