While strawberry can be attributed to tokenization here are some other basic stuff I’ve seen language models fail at: 1. Play tic tac toe such that you never l

While strawberry can be attributed to tokenization here are some other basic stuff I’ve seen language models fail at: 1. Play tic tac toe such that you never lose 2. Which is bigger 9.11 or 9.9 3. 4 digit multiplication even with CoT prompting