I just don't see how you can stop it from going off the rails though. For linear adventures, you have to carefully pick which items and actions are available to

I just don't see how you can stop it from going off the rails though. For linear adventures, you have to carefully pick which items and actions are available to avoid breaking puzzles e.g. if the LLM lets you break a window which creates a shard of glass, you could use the glass to cut a rope, when you were suppose to use a knife. It would probably be able to come up with decent reasons to explain why you can't do stuff though haha, which is often a part of good puzzle design e.g. "I don't want to draw attention by breaking the window".