3 ms·
LLMs basically can't do arithmetic directly, trying to get them to do so is a skill issue. Most models can and will happily write and execute code to do that wo
by vonneumannstan 1y ago
LLMs basically can't do arithmetic directly, trying to get them to do so is a skill issue. Most models can and will happily write and execute code to do that work instead.
- giancarlostoro 1y agoWhich drives me a little crazy. Every LLM worth its salt should just... MCP or whatever the arithmetic of any question, I assume the good ones do.
- Havoc 1y agoWhat I described is a setup that DOES have pandas & python access and uses it heavily to figure out the excel files. Which is neat, but the output is still wrong
- vonneumannstan 1y agoI'm sorry, what are you saying exactly? That a model like GPT 5 can't read an excel file and correctly sum rows based on filters? I find that incredibly hard to believe. GPT 4 from 2 years ago could do this with no issue.