4 ms·

I’d bet it’s using function calling out to a real chess engine. It could probably be proven with a timing analysis to see how inference time changes/doesn’t wit

• scratchyone 2y ago
  ?? why would openai even want to secretly embed chess function calling into an incredibly old model? if they wanted to trick people into thinking their models are super good at chess why wouldn't they just do that to gpt-4o?
  • semi-extrinsic 2y ago
    The idea is that they embedded this when it was a new model, as part of the hype before GPT-4. The fake-it-till-you-make-it hope was that GPT-4 would be so good it could actually play chess. Then it turned out GPT-4 sucked at chess as well, and OpenAI quietly dropped any mention of chess. But it would be too suspicious to remove a well-documented feature from the old model, so it's left there and can be chalked up as a random event.
• vbarrielle 2y ago
  If it were calling to a real chess engine there would be no illegal moves.
  • shtack 2y ago
    The instances of that happening are likely the LLM failing to call the engine for whatever reason and falling back to inference.