3 ms·
Seems like the model likes to repeat words in the title, particularly when hyphens are involved (I guess it considers them as different words?) e.g. "new dinos
by karagenit 5y ago
Seems like the model likes to repeat words in the title, particularly when hyphens are involved (I guess it considers them
as different words?) e.g. "new dinosaur-like dinosaur" and "male-pattern traits in male rats" are a couple I saw.
- minimaxir 5y agoThat's mostly a GPT-2/Transformers quirk. Some approaches apply a repetition penalty to work around it.