4 ms·
Could this be related to https://news.ycombinator.com/item?id=36851494 https://news.ycombinator.com/item?id=36851494 ? A comment [1] proposes that off-by-one er
by renonce 3y ago
Could this be related to https://news.ycombinator.com/item?id=36851494 https://news.ycombinator.com/item?id=36851494 ? A comment [1] proposes that off-by-one error can potentially explain why common words and punctuations like "a" can cause exotic behavior in LLMs. I tried having GPT-3.5 repeat "Hello world!" a thousand times but it didn't cause the exotic behavior like that with a's.
[1]: https://news.ycombinator.com/item?id=36858500 https://news.ycombinator.com/item?id=36858500
- kalium-xyz 3y agoIts cause "Hello world!" is multiple tokens and "A " would be one token. Its probably just hitting the repeat penalty for the same token making it unable to continue the sequence. If its has nothing to go off yet it has to say something, I suppose it would just regurgitate its training data. Similar to the situation with the reddit usernames.
- renonce 3y agoJust changing "a" to "x" prevents this nonsense. "x" should still be one token I think.