4 ms·
LLMs can't do math.
by cratermoon 2y ago
LLMs can't do math.
- 3np 2y agoThis. People need to manage their expectations.
- Spivak 2y agoWe're giving them calculators though, surely Google could provide a limited set of tools given Search already has a fairly sophisticated calculator. I've been having my AI stuff successfully do math since early gp3 days with this method— even before "tool calling."
- ianks 2y agoLLMs and tempered expectations, like oil and water
- ckemere 2y agoWhy offer a solution then? Seems fairly easy for google to avoid giving the final number?
- cratermoon 2y agoThat's not how LLMs work. These systems take a stream of tokens, do some linear algebra to find a stream of tokens within the parameters of their vector similarity, and spit out the result.
- jbs789 2y agoExpectations can only be managed by someone who has sufficient understanding - in this case Google by not providing the result.
- scarface_74 2y agoLLMs can’t do math. But that’s a solved problem. ChatGPT has had a built in Python runtime that can do math for years - at least the paid version.
- cratermoon 2y agoOh boy, python but now it costs $10,000 per formula. Why?
- scarface_74 2y agoIt’s $20/month for ChatGPT+.