2 ms·
No, it can refuse to talk by outputting an <eos> token at any point if it predicts that there is nothing more to be said. Technically still "just a token" yes,
by moffkalast 2y ago
No, it can refuse to talk by outputting an <eos> token at any point if it predicts that there is nothing more to be said.
Technically still "just a token" yes, but it does flow control instead.