3 ms·
Nobody does long-form arithmetic in the texts seen by these LLMs. Everyone uses calculators, so the AIs only see the result, not the step-by-step process to get
by jiggawatts 3y ago
Nobody does long-form arithmetic in the texts seen by these LLMs. Everyone uses calculators, so the AIs only see the result, not the step-by-step process to get there.
I would expect the models to be bad at, say, division of long numbers in the same way humans are bad at doing the same calculations in their head!
- meghan_rain 3y agoWould sythetically generating millions of calculation examples and adding that to the training data help?
- jiggawatts 3y agoYes, but it is a "waste of its capacity" in the same way it's a waste of the human brain's potential to learn numeracy to this level. Calculators are cheap, readily available, and don't make errors. I'd be more interested in having the thing "study maths" in the sense of seeing many examples of Wolfram Language being used in matching English context. That way, it would learn the English->Maths mapping in a format that it can then feed into an industrial-strength mathematics engine. Apparently, Stephen Wolfram is working on this now, but the "full" fine tuning training would require significant funding and time. I suspect OpenAI has other priorities right now, but this type of thing will eventually become a routine way of making specialised and/or more capable large language models.