3 ms·
The question is whether this is a better approach than just giving the LLM access to calculator / python-interpreter.
by thomasahle 4y ago
The question is whether this is a better approach than just giving the LLM access to calculator / python-interpreter.
- IIAOPSW 4y agoWhats the difference between math and a language? Its all just literals (numbers) and verbs relating them (+,-,*,/).
- thomasahle 4y agoLarge Language Models are bad at a lot of the same things humans are bad at. For example, humans can't add or multiply large numbers in their head. They need a piece of paper as an axillary memory. Or a calculator. If we need to find the shortest path in a graph, we write a short program to do it. Likewise a Large Language Model can easily write the source code to do addition for arbitrarily large numbers, or solve graph related problems. (See AlphaCode.) It's not clear that they need to be "Generalist Algorithmic Learners" as this paper suggests. Time will tell.
- kelseyfrog 4y agoOr a little recurrent ALU side-chain glued on. It would at the very least put a stop to the "It can't even multiple two four-digit numbers correctly," squad which I admit, I can't do in my head either.