2 ms·
There’s plenty of different ways you can use the output of those functions to feed a new token sequences back to the model, but you can only feed a specific tok
by Retric 3y ago
There’s plenty of different ways you can use the output of those functions to feed a new token sequences back to the model, but you can only feed a specific token not the full probability distribution from a prior run.
As to randomness that’s simply one approach, there’s deterministic approaches that have their own advantages. What randomness provides over them is avoiding always responding to the same opening in the same way as that’s quite off-putting.