Does this really work though? I know nothing about the inner workings of LLMs, but don't you want to break their word associations? Rather than generating "garb

Does this really work though? I know nothing about the inner workings of LLMs, but don't you want to break their word associations? Rather than generating "garbage" text based on which words tend to occur together and LLMs generating text based on which words it has seen together, don't you want to give them text that relates unrelated words?