4 ms·
One of the tokens represents stopping. If you sample stop from the probability distribution instead of a normal text token, then you stop autoregressive samplin
by epr 2y ago
One of the tokens represents stopping. If you sample stop from the probability distribution instead of a normal text token, then you stop autoregressive sampling.