4 ms·
>Nor do they understand mathematics Eh, you might be looking too closely at GPT-3/4 and not some of the splitoff models that are trained around math itself. Th
by pixl97 4y ago
>Nor do they understand mathematics
Eh, you might be looking too closely at GPT-3/4 and not some of the splitoff models that are trained around math itself. They seem to have much higher success rates than pure language models, and because we have success there already, I don't see it being a long term issue before it's incorporated into something like gpt-5.
- alfalfasprout 4y agoI've been following the work on MathPrompter (https://arxiv.org/pdf/2303.05398.pdf https://arxiv.org/pdf/2303.05398.pdf) for example. These approaches certainly increase the quality of basic results but without a true semantic model of mathematics we're a looooooong way from replacing a computer algebra system.
- keskival 4y agoAll the language models are able to use tools such as Python or theorem provers. They don't need to do calculations "in their head".