Nucleus sampling can increase the rambling horizon for some datasets and models by some small percentage. A top-k sampled model might start rambling after 50 wo

Nucleus sampling can increase the rambling horizon for some datasets and models by some small percentage. A top-k sampled model might start rambling after 50 words and a nucleus sampled model perhaps can keep going until 60 words. But even with nucleus sampling, the text will eventually degenerate.