7 ms·
LLMs operate at token level, not word. it doesn't operate in terms of "traumatic", "over-training", "over" or "training", but rather "tr" "aum" "at" "ic, ", etc
by jcelerier 1y ago
LLMs operate at token level, not word. it doesn't operate in terms of "traumatic", "over-training", "over" or "training", but rather "tr" "aum" "at" "ic, ", etc.
- typpilol 1y agoWeird thing I've noticed. Some LLMs can output nerd font glyphs and others can't. If I recall grok code fast can but codex and sonnet can't
- magicalhippo 1y ago> it doesn't operate in terms of "traumatic", "over-training", "over" or "training", but rather "tr" "aum" "at" "ic, ", etc. And "毛片免费观看" (Free porn movies), "天天中彩票能" (Win the lottery every day), "热这里只有精品" (Hot, only fine products here) etc[1]. [1]: https://news.ycombinator.com/item?id=45483924 https://news.ycombinator.com/item?id=45483924
- TZubiri 1y agoI think you are confusing tokens with vectors/embedding/parameters. king and rex (king in latin) map to different tokens but will map to very similar vectors.