4 ms·
I noticed that LLM at least at the Claude and OpenAI 4o level can not play tic tac toe and win against a competent opponent. They make illogical moves. Intere
by bhouston 2y ago
I noticed that LLM at least at the Claude and OpenAI 4o level can not play tic tac toe and win against a competent opponent. They make illogical moves.
Interestingly, they can write a piece of code to solve Tic Tac Toe perfectly without breaking a sweat.
- 3vidence 2y agoPlaying tic tac toe could be such a basic topic that there is relatively little information on the internet about how to "always" win. On the other hand writing a piece of code to solve Tic Tac Toe sounds like it could be a relatively common coding challenge.
- eek2121 2y agoWin or stalemate? because a stalemate is the likely scenario against a somewhat competent opponent IMO.
- levocardia 2y agoI've always said that appending "use python" to your prompt is a magic phrase that makes 4o amazingly powerful across a wide range of tasks. I have a whole slew of things in my memories that nudge it to use python when dealing with anything even remotely algorithmic, numeric, etc
- potatoman22 2y agoIt might be the way you're formatting the input. I wonder how they perform when state updates are shared via natural language vs ASCII art vs image
- bhouston 2y agoI tried a bunch of different ways. It wasn’t the prompt or input format.