3 ms·You can also get the token probs and only sample from the ones that would be valid for each token.by quickthrower2 3y agoYou can also get the token probs and only sample from the ones that would be valid for each token.