I think it is a common misconception for anyone who hasn’t actually tried implementing a LLM to think that there is a best choice of token at each step and that

I think it is a common misconception for anyone who hasn’t actually tried implementing a LLM to think that there is a best choice of token at each step and that following every locally best choice will lead to a globally “best” writing. This is intuitive yet wrong and perhaps there is no better way to rid oneself of this misconception other than actually implementing a simple LLM.