Getting AI to show its work isn't just for accountability. "Showing your work" gives you a clearer picture of the problem / solution and prevents / fixes bugs i

Getting AI to show its work isn't just for accountability. "Showing your work" gives you a clearer picture of the problem / solution and prevents / fixes bugs in implicit reasoning, the key problem current AI has which prevents it from being truly autonomous. Ask GPT4 to do a task, and then ask it to the same task showing its work; you'll find that GPT4 is less likely to make mistakes on the latter. This is especially apparent for tasks like counting # of words and multi-step problems, which GPT normally has trouble with. But GPT4 still tends to struggle even breaking the task down, to the point where it starts producing extremely obvious mistakes (e.g. "the turtle moves 1 unit up, from (1, 0) to (2, 0)"). One possibility is that it isn't actually showing its work, it's just generating backwards explanations from a latent conclusion. Maybe this research will clarify whether this is the case, and help us develop a more coherent LLM.