His system prompt is too specific. It worked for me with GPT 4o using this prompt: ---- System prompt: Please note that words coming to you are tokenized, so

His system prompt is too specific. It worked for me with GPT 4o using this prompt: ---- System prompt: Please note that words coming to you are tokenized, so when you get a task that has anything to do with the exact letters in words, you should solve those using the python interpreter. Prompt: How many r's are in the word strawberry? ---- This whole thing is a non-problem. Adding in this hint into the system prompt the whole topic is solved once and for all. I would argue that if the training data would include this wisdom, it would be even a non-problem without the system prompt.