2 ms·
There might be no reasoning in a single pass which outputs a single token. But in the loop where the output of the LLM repeatedly gets fed back into its input,
by mg 3y ago
There might be no reasoning in a single pass which outputs a single token. But in the loop where the output of the LLM repeatedly gets fed back into its input, reasoning is clearly happening:
The LLMs lay out how to go about figuring out the answer, do a series of calculation steps and then come up with an answer.
If you add "Please answer in just one short sentence." to the prompt, even the top ones get it wrong.
- visarga 3y agoReasoning is also an iterative process. Besides scaling in response length, the model can also get multiple feedbacks from outside to correct itself.
- spyder 3y agoYep, humans too have to think before answering most non-trivial questions, and especially the ones that include calculations. So it seems "obvious" that we should try to to give LLMs too some time to think before answering, for example with the popular methods of asking for step-by-step thinking, thinking out loud, and only giving the final answer at the end, and also asking it to proofread and correct it's answers at the end all can help with that. Pause tokens (thinking tokens) are also an interesting method to achieve that and seems to have a positive effect on performance: https://arxiv.org/abs/2310.02226 https://arxiv.org/abs/2310.02226