3 ms·
Still gets 3 r's in strawberry shortcake in a fresh context: https://i.imgur.com/EGI2UT9.png https://i.imgur.com/EGI2UT9.png If I'm understanding, your theory
by Ukv 2y ago
Still gets 3 r's in strawberry shortcake in a fresh context: https://i.imgur.com/EGI2UT9.png https://i.imgur.com/EGI2UT9.png
If I'm understanding, your theory is:
* When asked for r's in strawberry it outputs 2 because it's interpreting your question as whether the second r-sound has one or two r's
* It also miscounts 2 r's in strawberry when you're clear you don't mean that, or use strawberry as part of another phrase, due to how tokens work
But then that makes the part about interpreting the question as "r's in the second r-sound" superfluous (https://i.imgur.com/eYKYRfN.png https://i.imgur.com/eYKYRfN.png), if it counts 2 r's in strawberry anyway. There's no need for it to also be misinterpreting what you meant.
- jdthedisciple 2y ago> Still gets 3 r's in strawberry shortcake in a fresh context: https://i.imgur.com/EGI2UT9.png https://i.imgur.com/EGI2UT9.png Right, but again this would be valid according to the r-sound-interpretation. To be precise, we actually have 3 possible interpretations of the question: 1- how many r's are spelled in strawberry in total (this is what everyone assumes is the intended question) 2- how many r-sounds are in strawberry 3- is it 1 or 2 r's in strawberry My theory was just that we don't know which of the three the LLM thinks was intended, given that its answer is valid for 2/3 of them. But I must admit that it seems hard to find examples where the LLM clearly assumes option 2 or 3. So maybe the token-based explanation suffices after all.