4 ms·
What's with this how many r's in a strawberry thing I keep seeing?
by lloydatkinson 2y ago
What's with this how many r's in a strawberry thing I keep seeing?
- arresin 2y agoIt’s a common LLM riddle. Apparently many fail to give the right answer.
- seydor 2y agoSomebody please ask o1 to solve it
- lloydatkinson 2y agoThe link shows it solving it
- dr_quacksworth 2y agoLLM are bad at answering that question because inputs are tokenized.
- swalsh 2y agoModels don't really predict the next word, they predict the next token. Strawberry is made up of multiple tokens, and the model doesn't truely understand the characters in it... so it tends to struggle.
- runjake 2y agoThis became something of a meme. https://community.openai.com/t/incorrect-count-of-r-characters-in-the-word-strawberry/829618 https://community.openai.com/t/incorrect-count-of-r-characte...
- andrewla 2y agoWhat's amazing is that given how LLMs receive input data (as tokenized streams, as other commenters have pointed out) it's remarkable that it can ever answer this question correctly.