3 ms·
The solution proposed in that paper, nucleolus sampling, effectively solves this problem though...
by Der_Einzige 6y ago
The solution proposed in that paper, nucleolus sampling, effectively solves this problem though...
- skybrian 6y agoIt’s an odd hack, though. Adding a bit of randomness results in a more interesting exploration of Borge’s Library of Babel, but it seems weird to assign meaning to the word choice?
- bjourne 6y agoNucleus sampling can increase the rambling horizon for some datasets and models by some small percentage. A top-k sampled model might start rambling after 50 words and a nucleus sampled model perhaps can keep going until 60 words. But even with nucleus sampling, the text will eventually degenerate.