Not just “uncommon tokens”. In the case when generation does weighted random sampling, it autoregressively takes its own past tokens into account. It generates

Not just “uncommon tokens”. In the case when generation does weighted random sampling, it autoregressively takes its own past tokens into account. It generates whole different sequences. So if it’s diversity of output you want, you will get it.