This behavior you’re describing is trainable either way. Tuned LLMs are not simple most likely token models. They are most likely token given a general overarc

This behavior you’re describing is trainable either way. Tuned LLMs are not simple most likely token models. They are most likely token given a general overarching strategy for contextualizing future tokens model. Which can be conservative or imaginative.