Pretty sure this happens when it chooses a less-likely token after some amount of repetition, which is usually what you want so that it doesn’t get stuck in loo

Pretty sure this happens when it chooses a less-likely token after some amount of repetition, which is usually what you want so that it doesn’t get stuck in loops of saying the most likely next token (in a string of company company company company the next most likely will be company)