2 ms·
Some studies are trying to ensure that the model reasons through abstractions instead of linguistic representations. (Of course the phenomenon of reasoning in s
by mdp2021 2y ago
Some studies are trying to ensure that the model reasons through abstractions instead of linguistic representations. (Of course the phenomenon of reasoning in substantially different quality depending on input language signals a fault - reasoning is beyond "spoken" language.)
In the past hours a related, seemingly important article appeared - see https://www.quantamagazine.org/to-make-language-models-work-better-researchers-sidestep-language-20250414/ https://www.quantamagazine.org/to-make-language-models-work-...
- jmmcd 2y agoThis important paper from Anthropic includes evidence that part (but only part) of reasoning is cross-lingual: https://www.anthropic.com/research/tracing-thoughts-language-model https://www.anthropic.com/research/tracing-thoughts-language...