3 ms·
But can it count the R's in strawberry?
by number6 7mo ago
But can it count the R's in strawberry?
- Aditya_Garg 7mo agoyes its ridiculously good at stuff like that now. I dare you to try and trick it.
- frizlab 7mo agohttps://news.ycombinator.com/item?id=47495568 https://news.ycombinator.com/item?id=47495568
- thedatamonger 7mo agowhat bothers me is not that this issue will certainly disappear now that it has been identified, but that that we have yet to identify the category of these "stupid" bugs ...
- sigmoid10 7mo agoWe already know exactly what causes these bugs. They are not a fundamental problem of LLMs, they are a problem of tokenizers. The actual model simply doesn't get to see the same text that you see. It can only infer this stuff from related info it was trained on. It's as if someone asked you how many 1s there are in the binary representation of this text. You'd also need to convert it first to think it through, or use some external tool, even though your computer never saw anything else.
- datsci_est_2015 7mo agoOkay but, genuinely not an expert on the latest with LLMs, but isn’t tokenization an inherent part of LLM construction? Kind of like support vectors in SVMs, or nodes in neural networks? Once we remove tokenization from the equation, aren’t we no longer talking about LLMs?
- fenomas 7mo agoIt's not a side effect of tokenization per se, but of the tokenizers people use in actual practice. If somebody really wanted an LLM that can flawlessly count letters in words, they could train one with a naive tokenizer (like just ascii characters). But the resulting model would be very bad (for its size) at language or reasoning tasks. Basically it's an engineering tradeoff. There is more demand for LLMs that can solve open math problems, but can't count the Rs in strawberry, than there is for models that can count letters but are bad at everything else.
- Measter 7mo ago> It's as if someone asked you how many 1s there are in the binary representation of this text. I'm actually kinda pleased with how close I guessed! I estimated 4 set bits per character, which with 491 characters in your post (including spaces) comes to 1964. Then I ran your message through a program to get the actual number, and turns out it has 1800 exactly.
- sigmoid10 7mo ago>I estimated 4 set bits per character, which with 491 characters in your post (including spaces) comes to 1964 And that's exactly the kind of reasoning an LLM does when you ask it about characters in a word. It doesn't come from the word, it comes from other heuristics it picked up during training.
- deleted 7mo ago[deleted]
- Paradigma11 7mo agoThat question is equivalent to asking a human to add the wavelengths of those two colors and divide it by 3.
- snovv_crash 7mo agoUnless you're aware of hyperspectral image adapters for LLMs they aren't capable of that either.
- szszrk 7mo agoUnfair - human beats AI in this comparison, as human will instantly answer "I don't know" instead of yelling a random number. Or at best "I don't know, but maybe I can find out" and proceed to finding out/ But he is unlikely to shout "6" because he heard this number once when someone talked about light.
- thegabriele 7mo agoWhy is that?
- deleted 7mo ago[deleted]
- Paradigma11 7mo agoBecause LLMs dont have a textual representation of any text they consume. Its just vectors to them. Which is why they are so good at ignoring typos, the vector distance is so small it makes no difference to them.