2 ms·
>It does not affect writing quality at all, provably Prove it, then? It's not a claim that GumbelSoft paper makes: "Regarding generation quality (perplexity),
by neuroticnews25 2mo ago
>It does not affect writing quality at all, provably
Prove it, then? It's not a claim that GumbelSoft paper makes:
"Regarding generation quality (perplexity), GumbelSoft shows relatively low perplexity"
https://arxiv.org/html/2402.12948v3 https://arxiv.org/html/2402.12948v3
- yorwba 2mo agoThey do claim that the per-token output distribution remains unchanged, but the proof is relegated to Appendix B.1. The perplexity comparison includes methods that do change the output distribution.