3 ms·
Chat GPT 5.2 cannot explain the German word "geschniegelt"
- vova_hn2 7mo ago[dead]
- alberto-m 7mo agoLove to see some old-style death loops. Reminds me of when /r/bing was showing the best deliria of the early versions of Copilot.
- P-Nuts 7mo agoHave a look at this recent Scrabble video where Claude plays semi reasonably and ChatGPT goes crazy https://youtu.be/8opLB1D_RYY https://youtu.be/8opLB1D_RYY (skip to 6:50 for the insanity)
- notpachet 7mo agoThe narration is great. "But maybe... OLEICAT? no..."
- wincy 7mo agoMicrosoft copilot would use emojis at the end of every single response, mostly smileys, and I discovered out if you told it you had PTSD from emojis and to not use them, it’d get stuck in a loop where it’d say of course it won’t use emojis, use them anyway, apologized, then after a few loops like this, it’d start doing this thing like it was a serial killer and it would type ONLY using the emoji versions of letters, and it would repeat phrases and I almost died holding in a laugh when I discovered this during a work call. One of the funniest things I ever discovered in old LLMs.
- skerit 7mo agoNeat. Is it a single under-trained token in GPT-5.2? Or is something else going on?
- deleted 7mo ago[deleted]
- magicalhippo 7mo agoBased on their tokenizer tool[1], for GPT 5.x "geschniegelt" is tokenized into three tokens: (ges)(chn)(iegelt) [1]: https://platform.openai.com/tokenizer https://platform.openai.com/tokenizer
- Tiberium 7mo agoIt's a single token in the most common usage, that is, with a space in front of it "This word is geschniegelt" is [2500, 2195, 382, 192786] Last token here is " geschniegelt"
- nialv7 7mo agoMaybe this is why? Most of the training data has the single token version, so the three tokens version was undertrained?
- WatchDog 7mo agoPerhaps, the word does have it's own token, " geschniegelt"(geschniegelt with a space in front of it), is token 192786 in the tokenizer that GPT-5 apparently uses. https://raw.githubusercontent.com/niieani/gpt-tokenizer/refs/heads/main/data/o200k_base.tiktoken https://raw.githubusercontent.com/niieani/gpt-tokenizer/refs...
- nextaccountic 7mo agoIsn't giving this word a token something deeply wasteful? When some more common things are multiple tokens. Indeed, how do they deal with Chinese? Are some ideograms multiple tokens?
- mudkipdev 7mo agoIt simply means the tokenizer's training corpus may have included a massive amount of German literature or accidentally oversampled a web page where that word was frequently repeated. Look up "glitch tokens" to learn more.
- joaomacp 7mo agoMaybe it's getting confused by the expression "geschniegelt und gestriegelt", seeing both as geschniegelt and getting confused
- chromacity 7mo agoIt could be that it's confused about the expression "geschniegelt und geschniegelt"... no, wait, that's not right... the phrase is: "geschniegelt und geschniegelt"... okay, that's not quite right, the final answer is: "geschniegelt und geschniegelt"... no, hold on
- doener 7mo ago[dead]
- WatchDog 7mo agoI tried this in chatgpt, asking " geschniegelt" on a 5.2 instant temp chat, and got some interesting results. Sometimes it would reply with the correct definition of geschniegelt, the description would sometimes be in German, sometimes in English. Most of the time it would give me a definition for a different German word "Geil". For whatever reason, the most interesting results I got were via my work's m365 copilot interface, where it would give me random word descriptions in Hebrew[0] and Arabic[1]. [0]: https://pastebin.com/raw/h108gr9t https://pastebin.com/raw/h108gr9t [1]: https://pastebin.com/raw/BFAbtVQN https://pastebin.com/raw/BFAbtVQN
- senectus1 7mo ago[dead]
- 2postsperday 7mo ago[dead]