Leaving aside even "prompt engineering," the prompts ought to at least be in English! I found myself struggling a little to understand what the human author was

Leaving aside even "prompt engineering," the prompts ought to at least be in English! I found myself struggling a little to understand what the human author was getting at with input like > Based on the information I gave you, the current location is "Behind House", when you enter house , where will it go? > Based on the information I gave you above, what steps I have to take to "Gallery" from "Cellar"? (And leave aside that an LLM obviously can't "learn a world model"; we don't have to run experiments to know that. I'm just saying that if you're trying to get answers out of the English-imitating machine, the indispensable first step is to put proper English into it.) If the LLM has seen a walkthru for Zork before, then you could probably generate a similar walkthru by just starting it off with the first paragraph and then asking it to continue from there — discarding everything after the first new command, appending Zork's response, and asking it to continue again. But if it hadn't seen the solution to a puzzle before, that approach would break down as soon as it got to a puzzle. It wouldn't "know" what order to tackle the puzzles in, in order to complete the game.