3 ms·
No. The collapse is not as simple as simply shifting down most of the logits, so ramping up the temperature does little until outputs start degenerating.
by gwern 2y ago
No. The collapse is not as simple as simply shifting down most of the logits, so ramping up the temperature does little until outputs start degenerating.