3 ms·That's mostly a GPT-2/Transformers quirk. Some approaches apply a repetition penalty to work around it.by minimaxir 6y agoThat's mostly a GPT-2/Transformers quirk. Some approaches apply a repetition penalty to work around it.