6 ms·
Why does GPT-3 matter? Well, the article starts with a plot that shows what looks like an exponential growth in the number of parameters, compared with previous
by YeGoblynQueenne 6y ago
Why does GPT-3 matter? Well, the article starts with a plot that shows what looks like an exponential growth in the number of parameters, compared with previous models. So it matters because it's bigger.
Further down there's a plot titled "Aggregate Performance Across Benchmarks" where we can see that performance is on average about 50%. I don't know what the baseline for this plot should be (what is the expected average if the tasks are solved by a random classifier?) but comparing this plot with the plot at the top of the article, it doesn't really look like there's a huge improvement in accuracy with a huge increase in the number of parameters. In fact, it's quite the contrary: there's a small increase and a very smooth, almost linear curve. So that's an exponential increase in the use of resources for an almost linear increase in performance? That's not that impressive.
So it appears that the big thing about GPT-3 is that it's big.
It should also be noted that the public interest about GPT-3 is mostly focused on its ability to generate text, for which there is no good metric. So basically, GPT-3 is big, but it's not that good in tasks for which there are formal benchmarks (such as they are, because Natural Language Understanding benchmarks are often very poorly made and don't really measure what they say they measure) and we can't really tell how good it is in the one task that interests most people the most.
- YeGoblynQueenne 6y agoOh and note that this: >> GPT-3 can also finally do arithmetic, something GPT-2 was unable to do well. Is a preposterous claim that is very poorly supported by the data in the GPT-3 paper [1]. Figure 3.10 in the paper summarises the results. The authors tested addition between two to five digits, subtraction between two to five digits and multiplication between two digits drawn uniformly at random from [0,100]. There was also a composite task of addition, subtraction and multiplication with single-digit numbers (e.g. 6+(4*8), etc). On all tasks, other than two and three digit addition and subtraction, accuracy was uniformly under 20%. The other four tasks achieved high accuracy with more parameters. Of course, this doesn't show that the larger models "learned arithmetic". Two- and three-digit addition and subtraction are likely to be much better represented in a natural language dataset than other operations (and note of course the conspicuous absence of division). So it's safe to assume that the model has seen all the operations it's asked to repeat and knows their results by heart. Remember that for two and three digit addition and subtraction one only needs a dataset with the numbers up to 999, which is really tiny and easy to memorise. Edit: the authors note that they "spot checked" whether the model is simply memorising results, by searching for three-digit addition examples in their dataset. Out of 2000 three-digit addition problems they failed to find more than 17% in their dataset which "suggests" that the model had not ever seen the problems before. Or, it "suggests" the search was not capable of finding many more existing matches. In any case, why only "spot-check" three-digit addition? Who knows. The paper doesn't say. Certainly, one- and two-digit addition and subtraction should be much more common in a natural language dataset. The authors also say that the model often makes mistakes such as not carrying a one, so it must be actually performing arithmetic! Or, it's simply reproducing common arithmetic mistakes in its dataset. Overall, this sort of "testing" of arithmetic prowess simply doesn't cut the mustard. Edit 2: Also, no information about how many arithmetic problems of each type were tried. One? Ten? One hundred? Where all arithmetic tasks tested with the same number of problems? Unknown. _____________ [1] https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165
- stupidcar 6y agoYour skepticism seems very poorly supported by the data.
- throwaway525142 6y agoCare to elaborate?
- stevenhuang 6y agoIt's possible the prompts used by the researchers to gauge arithmetic ability could be improved by changing to a more conversational style. I found these series of tweets almost unbelievable in how well GPT-3 seems to reason about function composition f(f(x)). "I wonder if the AI would be better at math if you told it to show it's work": https://twitter.com/kleptid/status/1284098635689611264?s=20 https://twitter.com/kleptid/status/1284098635689611264?s=20
- YeGoblynQueenne 6y agoThe important thing to understand is that there is no obvious reason why a language model should be good at arithmetic, rather than reproducing results in its training set. OpenAI is claiming that it is, which is tantamount to invoking magick. They need to back up their very strong claim with very strong evidence. They haven't, so it's nothing more than an absurd claim that follows in a long line of absurd claims about AI, since the early days of the field.
- dddbbb 6y agoBut the example the poster you are replying to gave shows that GPT-3 can take the square root of a user-defined function composed with itself. It clearly can perform arithmetic, and we don't need to trust OpenAI now that users can interact with the model.
- YeGoblynQueenne 6y ago
- quanticle 6y agoThe significance of GPT-3 is that the scaling isn't slowing down. With every increase in the number of parameters the doubters say, "Oh, you'll hit diminishing returns," or "Oh, the curve will go sigmoid," but it hasn't happened. If OpenAI develops GPT-4, with 1T parameters, I wouldn't be surprised to see a performance gain larger than the jump between GPT-2 and GPT-3. What GPT-3 shows us is that we're going to have ML systems that can write at the level of an average human pretty soon now.
- YeGoblynQueenne 6y ago>> The significance of GPT-3 is that the scaling isn't slowing down. Can I ask- who says this? Is it your personal opinion? Is it the conclusion of the article above, as you understand it? Is it a commonly held opinion of some of the experts in language modelling? I am asking because everytime there is a claim like "X is important because Y" and someone points out that "Y" is not that interesting, if someone else then says "X is important because Z" and Z is not Y, it's very difficult to have a productive conversation, because it's very difficult to know what we are talking about. Of course, this is the internets and not scientific debate (typically carried out in peer reviewed publications) but if the goalposts keep moving all the time, it's pointless to even try to have a conversation about the merits and flaws of such a complex system. That, with all due respect. Now, regarding whether GPT-3 is slowing down, it isn't, but it's not going very fast either. Like I say, the curve in the middle of the article that shows acccuracy as a function of parameters is quite flat. Depending on how you want to define diminishing returns, the image painted by the accuracy plot is not that far from it and in any case average accuracy is pretty disappointing. >> What GPT-3 shows us is that we're going to have ML systems that can write at the level of an average human pretty soon now. Like I say, there's no good metrics for this kind of task. We have no way to determine what is writing "at the level of an average humen" (let alone what is an "average human"), except eyballing output and expressing a subjective opinion. Anyone might claim that GPT-3 is already capable of writing "at the level of an average human". Anyone might claim that GPT-2 is. Or a Hidden Markove Model, or an n-gram model. Such claims really don't mean anything at all. It is important to note that this is exactly the task that OpenAI has publicised the most, with GPT-3: a poorly defined task with no good metrics. This insistence in promoting an ability that cannot be objectively evaluated as being a strong point of the model is strong evidence that the model is not nearly as good as advertised.
- bananaface 6y agoMoore's law is exponential. If parallel processing power continues to rise exponentially...
- Voloskaya 6y ago> So basically, GPT-3 is big, but it's not that good in tasks for which there are formal benchmarks It is very good in all those tasks. In the paper all the numbers comparing GPT-3 with other models on those benchmark are comparing GPT-3 in a zero/one/few shot setting (so no gradient step), against the previous state of the art finetuned for hours or days on the specific task with millions of gradients steps. If you had time and money to finetue GPT-3 on the specific task there is every reason to believe the gap would be huge. This is the big thing about GPT-3, the promise of not needing to finetune anymore. This is huge in term of productivity but also because it allows you to use the model in settings for which there are basically no dataset available to finetune on.
- YeGoblynQueenne 6y ago>> If you had time and money to finetue GPT-3 on the specific task there is every reason to believe the gap would be huge. On the contrary, there is every reason to assume that GPT-3 cannot significantly improve its results on those tasks with extensive fine tuning. Because, if GPT-3 could significantly improve its performance on those tasks with extensive fine-tuning, the OpenAI paper would be reporting those results (edit: OpenAI sure has the time and money to finetune their model). As we all know by now, there is strong bias in never reporting negative results in machine learning as in other research fields, so we can be reasonably certain that if there is an obvious experiment to perform and that experiment is missing from a paper, it was attemtped and the results were poor.
- popcorncolonel 6y agoNot necessarily. There have been a number of papers trying to emphasize the generalization power of a network rather than "it got a SOTA number", and so leave off fine tuning results. Because that would distract from the point of the paper.
- Voloskaya 6y agoI entirely disagree with your interpretation : > "OpenAI sure has the time and money to finetune their model" This model is absolutly gigantic. In term of training it's a nightmare. I am pretty sure they don't have the capacity to train 10 of them in parallel. So finetuning on all the downstream task needs to be done basically in serial and takes forever. They might have a lot of money, but time is as important for them than for anyone else, their lab isn't at the edge of black hole. If what you are saying is true I am pretty sure they would have reported it because it would be an extremely interesting and important result in my opinion. If finetuning gave you no advantage over a few shot settings, it would basically mean that the model already know everything there is to know about the task just from it's pretraining and any additional training is useless as the model is not learning anything. Finally, given the pre-training curves with various model sizes, we clearly haven't reached saturation there, there is no indication anywhere that we have reached saturation on downstream task. So, for me the far more likely explanation is that fine-tuning on downstream tasks is indeed very costly (time and/or money) even by their standard and isn't even on topic for this paper.
- visarga 6y agoThe Aggregate performance graph shows how GPT-3 does translation and other tasks without ever learning to do that. Just by a simple example of translation, it understands the task and does translation. By another example, it can do math, and by another one it can do reasoning, or write react apps. All without having been explicitly trained in those tasks. This means we could potentially dig out thousands of uses out of it by carefully crafting triggers. It's a more general kind of tool than what we're accustomed to work with. It opens a new direction that might become a large field in five years, if they manage to make it run on a regular computer. <rant>I imagine a GPT-3 like model coupled with search (having Google in an internal loop), trained with multimedia - images, videos, audio, papers, code so it has grounded concepts, and being able to generate text, images, video and code as output. Then I imagine having curated thousands of tasks from the community and added in the training set so it becomes much more efficient, and having all these capabilities exposed as a general AI library. It will be able to work with any modality and you will be able to describe your task in natural language. All of these are possible today. GPT-3 has shown the power of learning to predict on 500B tokens.</>
- BenoitEssiambre 6y ago>All without having been explicitly trained in those tasks. Can you elaborate on what kind of training data was used here? I'm curious.
- visarga 6y ago500 billion word pieces (it splits words into few-character long pieces), which comes down to 100-200B words, scraped off the internet. It used mostly CommonCrawl as training data. It's like the proverbial witch's pot where they put everything in and out comes the magic.
- YeGoblynQueenne 6y agoYes, that's an apt metaphor. Magic, indeed.
- YeGoblynQueenne 6y ago
- jcims 6y agoI don't know that the benchmarks capture the subjective difference in GPT-2 and GPT-3. It's much better. I really feel like the lack of explainability is preventing us from understanding how to compose prompts to achieve the best outcome. There are subtle input differences (including whitespace) that result in large differences in output.