4 ms·
Oh and note that this: >> GPT-3 can also finally do arithmetic, something GPT-2 was unable to do well. Is a preposterous claim that is very poorly supported b
by YeGoblynQueenne 6y ago
Oh and note that this:
>> GPT-3 can also finally do arithmetic, something GPT-2 was unable to do well.
Is a preposterous claim that is very poorly supported by the data in the GPT-3 paper [1]. Figure 3.10 in the paper summarises the results. The authors tested addition between two to five digits, subtraction between two to five digits and multiplication between two digits drawn uniformly at random from [0,100]. There was also a composite task of addition, subtraction and multiplication with single-digit numbers (e.g. 6+(4*8), etc).
On all tasks, other than two and three digit addition and subtraction, accuracy was uniformly under 20%. The other four tasks achieved high accuracy with more parameters.
Of course, this doesn't show that the larger models "learned arithmetic". Two- and three-digit addition and subtraction are likely to be much better represented in a natural language dataset than other operations (and note of course the conspicuous absence of division). So it's safe to assume that the model has seen all the operations it's asked to repeat and knows their results by heart. Remember that for two and three digit addition and subtraction one only needs a dataset with the numbers up to 999, which is really tiny and easy to memorise.
Edit: the authors note that they "spot checked" whether the model is simply memorising results, by searching for three-digit addition examples in their dataset. Out of 2000 three-digit addition problems they failed to find more than 17% in their dataset which "suggests" that the model had not ever seen the problems before. Or, it "suggests" the search was not capable of finding many more existing matches. In any case, why only "spot-check" three-digit addition? Who knows. The paper doesn't say. Certainly, one- and two-digit addition and subtraction should be much more common in a natural language dataset. The authors also say that the model often makes mistakes such as not carrying a one, so it must be actually performing arithmetic! Or, it's simply reproducing common arithmetic mistakes in its dataset. Overall, this sort of "testing" of arithmetic prowess simply doesn't cut the mustard.
Edit 2: Also, no information about how many arithmetic problems of each type were tried. One? Ten? One hundred? Where all arithmetic tasks tested with the same number of problems? Unknown.
_____________
[1] https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165
- stupidcar 6y agoYour skepticism seems very poorly supported by the data.
- throwaway525142 6y agoCare to elaborate?
- stevenhuang 6y agoIt's possible the prompts used by the researchers to gauge arithmetic ability could be improved by changing to a more conversational style. I found these series of tweets almost unbelievable in how well GPT-3 seems to reason about function composition f(f(x)). "I wonder if the AI would be better at math if you told it to show it's work": https://twitter.com/kleptid/status/1284098635689611264?s=20 https://twitter.com/kleptid/status/1284098635689611264?s=20
- YeGoblynQueenne 6y agoThe important thing to understand is that there is no obvious reason why a language model should be good at arithmetic, rather than reproducing results in its training set. OpenAI is claiming that it is, which is tantamount to invoking magick. They need to back up their very strong claim with very strong evidence. They haven't, so it's nothing more than an absurd claim that follows in a long line of absurd claims about AI, since the early days of the field.
- dddbbb 6y agoBut the example the poster you are replying to gave shows that GPT-3 can take the square root of a user-defined function composed with itself. It clearly can perform arithmetic, and we don't need to trust OpenAI now that users can interact with the model.
- YeGoblynQueenne 6y agoAnd yet it can't always correctly subtract two two-digit numbers. Does that sound like a system that can perform arithmetic? As I say in previous comments, no. It sounds much more like a system that can reproduce resutls it has seen in trainig, but has no general concept of arithmetic. This would also explain the square root example example easily. Also, the examples in the OP's linked tweet are very simple examples of square roots and function composition that are very likely to have been lifted verbatim from some textbook, or who knows what ...and that's the problem, because who knows what the model has flat memorised and what it's composing from smaller components. >> It clearly can perform arithmetic, and we don't need to trust OpenAI now that users can interact with the model. The paper I link above performed a systematic evaluation of GPT-3's arithmetic ability. Playing around with the OpenAI API and eyballing a few results is not going to give a clearer understaning of its abilities. In general, hitting a language model with a few queries is never going to give any clear understanding of its capabilities. Systematic evaluation is always necessary and the average user (or the non-average user) is not going to be able to do that.
- gwern 6y agoAs usual, YeGoblynQueene never has a good thing to say about deep learning, and isn't nearly as expert as they think they are. Unlike you, OP has actually been paying attention, and he knows that the GPT-3 paper seriously understates the arithmetic performance of GPT-3 because they failed to deal with the BPE issue. If you use that by adding commas, you drastically improve the arithmetic. Matt Brockman has done some more systematic evaluation: http://gptprompts.wikidot.com/logic:math http://gptprompts.wikidot.com/logic:math
- kordlessagain 6y agoAnd did we mention you can't run it yourself?