3 ms·
Most of the value I get out of reasoning LLMs is their automatic tool use (web search + coding), and I can't think of a way "nonsensical web searches" would som
by astrange 1y ago
Most of the value I get out of reasoning LLMs is their automatic tool use (web search + coding), and I can't think of a way "nonsensical web searches" would somehow find relevant web answers.
- porridgeraisin 1y agoSure, that doesn't preclude what I said. If your training dataset includes tool use examples, then instead of <Nonsense CoT> <Answer> You would have <Nonsense CoT> <tool use> # maybe repeat this <More nonsense...> <Answer> Tool use output is out of distribution, my point was about the models own distribution.