4 ms·
> would result in lower quality output No it wouldn't. > seen it get stuck in certain endless sequences when doing that Yes, and infinite loops is just an in
by otabdeveloper4 1y ago
> would result in lower quality output
No it wouldn't.
> seen it get stuck in certain endless sequences when doing that
Yes, and infinite loops is just an inherent property of LLMs, like hallucinations.
- fennecfoxy 1y agoHow would it not result in lower quality output? You're reducing the set of tokens that may be selected to 1. The pool isn't necessarily synonyms but words that share some semantic connection to the previous word, but the selection of one word in particular can certainly impact the word that is selected next. Explain your reasoning otherwise.
- otabdeveloper4 1y ago> You're reducing the set of tokens that may be selected to 1. Yes, reducing it to 1 token that is deemed to be the optimal token according to the model.