3 ms·
> LLMs have dramatically worse performance on basic algebra questions when you add in irrelevant information "Attention is all you need" / (It is part of the
by mdp2021 2y ago
> LLMs have dramatically worse performance on basic algebra questions when you add in irrelevant information
"Attention is all you need" /
(It is part of the general problem solving process to evaluate what is relevant and what is not.)
- moffkalast 2y agoDifferential attention that filters out noise is all you need :)