I don't think it's a temperature issue because everything except the words is still coherent. It's kept the overall document structure and even the right gramma

I don't think it's a temperature issue because everything except the words is still coherent. It's kept the overall document structure and even the right grammar. Usually bad LLM sampling falls into an infinite loop too, though that was reported here.