3 ms·

Here’s why: https://www.gwern.net/GPT-3#repetitiondivergence-sampling https://www.gwern.net/GPT-3#repetitiondivergence-sampling

• layer8 5y ago
  This seems to say that nobody really understands why.