3 ms·
Honestly, if we're only talking about SOTA llms, in sandbox mode without harness? No shot. Without harness LLMs have no memory of previous moves. I can't make t
by orwin 8d ago
Honestly, if we're only talking about SOTA llms, in sandbox mode without harness? No shot. Without harness LLMs have no memory of previous moves. I can't make the last version of chatgpt remember more than 5 movements. I guarantee you, if you do not add flags in the harness with 'left rook moved' or 'right rook moved', it will try to illegally castle 100% of the time it's in the situation. Llm+harness, just make it call stockfish tbh.