5 ms·

What's the evidence?

by typon 6y ago

fossuser 6y ago
https://www.gwern.net/newsletter/2020/05#meta-learning https://www.gwern.net/newsletter/2020/05#meta-learning
- typon 6y ago
  The site you linked asserts "meta-learning" is happening in GPT3 without any evidence of it
  - fossuser 6y ago
    Isn't the capability to answer arithmetic prompts without the exact equation being present in the training data evidence? I'm not an AI researcher so I only have a lay-person's opinion from reading about this kind of thing via things like that blog post (I also don't have OpenAI access to play with the API myself), but if that is an accurate statement it seems like pretty good evidence of figuring out the underlying mathematical rules. I think this could be a path towards scaling being more effective than people think. I sense though that you're just arguing from a position of motivated reasoning based on a pre-existing conclusion rather than actually trying to look at new things that may contradict what you already believe to be true. Repeated one sentence responses arguing that none of this is evidence just isn't worth time to respond to. In the end we'll see what ends up happening.
    - deleted 6y ago
      [deleted]
- YeGoblynQueenne 6y ago
  Can I ask why you are not citing the GPT-3 paper itself? Why do we need to look somewhere else for evidence about anything to do with GPT-3 (or indeed any system) than the work of the people who have created it?
  - fossuser 6y ago
    That's a fair criticism, original paper would be better. I linked to the blog because that's where I first read about this and it's more immediately accessible. [Edit: Paper Link, https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165] In fact after reading these sections of the actual paper, it's hard to believe that you could have read it yourself and taken away the idea that it was memorization? Pages 22-23 in particular. Part of the reason I tend to link to good blog posts instead of academic papers is when you link to papers nobody reads them. Often people linking them haven't read them either (I've only read small parts).
    - YeGoblynQueenne 6y ago
      I think you're saying I didn't read the paper, because I didn't draw the same conclusions from it as you did after reading a blog post about it? Again there's a simpler explanation: I read the paper and I drew different conclusions than you or your primary source. I give a very long explanation of why I drew those conclusions, above. To clarify, I discussed the exact same subject a couple of weeks ago, I think, after reading the GPT-3 paper. I made my original comment in this thread without re-reading the paper, so I misremembered what was in it. Then I re-read the relevant section (3.9.1. Arithmetic) to refresh my memory and made the very long comment above. That's in the intereste of full disclosure and so you don't have any reason to assume I didn't read the paper, which you shouldn't anyway.
jointpdf 6y ago
This (GPT-3’s performance on arithmetic tasks) is covered in the original paper (https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165) Pages: 21-23, 63
- YeGoblynQueenne 6y ago
  See my reply above. The evidence in the paper does not support the claim that GPT-3 has learned rules of arithmetic (also claimed in the paper, not just in the OP's comment). There is a much simpler explanation, i.e. memorisation.
  - jointpdf 6y ago
    Your reply is misleading, sorry. You didn’t offer any actual evidence of your own to support the memorization claim. You didn’t even do your own arithmetic problem correctly. Since your performance on this task was <100% accurate, I can only assume you do not know the rules of arithmetic. > How many "x + y" questions can be formulated where x and y are both single-digit numbers? The answer is 2^10, or 100. Less snarkily, if there’s (10^4)^2 = 100 million combinations of 4 digit addition problems, and GPT-3 is reaching 25.5% accuracy on those problems (vs. 0.4% in the 13B parameter model). For 3 digit problems, it’s even better: 1 million combinations and 80.4% accuracy. Clearly, there is more happening than simple memorization—the training set does not contain 800k 3-digit addition problems. Thus, it’s fair to say that the model has at least a partial grasp of how to perform arithmetic operations (but probably not fair to say that it has synthesized the entire system of arithmetic). Also, the paper does say that they scrubbed exact examples from the training set to avoid memorization, a fact you left out: > (pg. 23): ”To spot-check whether the model is simply memorizing specific arithmetic problems, we took the 3-digit arithmetic problems in our test set and searched for them in our training data in both the forms "<NUM1> + <NUM2> =" and "<NUM1> plus <NUM2>". Out of 2,000 addition problems we found only 17 matches (0.8%) and out of 2,000 subtraction problems we found only 2 matches (0.1%), suggesting that only a trivial fraction of the correct answers could have been memorized. In addition, inspection of incorrect answers reveals that the model often makes mistakes such as not carrying a “1”, suggesting it is actually attempting to perform the relevant computation rather than memorizing a table.”

What's the evidence?

by typon 6y ago

What's the evidence?

fossuser 6y ago

https://www.gwern.net/newsletter/2020/05#meta-learning https://www.gwern.net/newsletter/2020/05#meta-learning

typon 6y ago
The site you linked asserts "meta-learning" is happening in GPT3 without any evidence of it
- fossuser 6y ago
  Isn't the capability to answer arithmetic prompts without the exact equation being present in the training data evidence? I'm not an AI researcher so I only have a lay-person's opinion from reading about this kind of thing via things like that blog post (I also don't have OpenAI access to play with the API myself), but if that is an accurate statement it seems like pretty good evidence of figuring out the underlying mathematical rules. I think this could be a path towards scaling being more effective than people think. I sense though that you're just arguing from a position of motivated reasoning based on a pre-existing conclusion rather than actually trying to look at new things that may contradict what you already believe to be true. Repeated one sentence responses arguing that none of this is evidence just isn't worth time to respond to. In the end we'll see what ends up happening.
  - deleted 6y ago
    [deleted]
YeGoblynQueenne 6y ago
Can I ask why you are not citing the GPT-3 paper itself? Why do we need to look somewhere else for evidence about anything to do with GPT-3 (or indeed any system) than the work of the people who have created it?
- fossuser 6y ago
  That's a fair criticism, original paper would be better. I linked to the blog because that's where I first read about this and it's more immediately accessible. [Edit: Paper Link, https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165] In fact after reading these sections of the actual paper, it's hard to believe that you could have read it yourself and taken away the idea that it was memorization? Pages 22-23 in particular. Part of the reason I tend to link to good blog posts instead of academic papers is when you link to papers nobody reads them. Often people linking them haven't read them either (I've only read small parts).
  - YeGoblynQueenne 6y ago
    I think you're saying I didn't read the paper, because I didn't draw the same conclusions from it as you did after reading a blog post about it? Again there's a simpler explanation: I read the paper and I drew different conclusions than you or your primary source. I give a very long explanation of why I drew those conclusions, above. To clarify, I discussed the exact same subject a couple of weeks ago, I think, after reading the GPT-3 paper. I made my original comment in this thread without re-reading the paper, so I misremembered what was in it. Then I re-read the relevant section (3.9.1. Arithmetic) to refresh my memory and made the very long comment above. That's in the intereste of full disclosure and so you don't have any reason to assume I didn't read the paper, which you shouldn't anyway.

jointpdf 6y ago

This (GPT-3’s performance on arithmetic tasks) is covered in the original paper (https://arxiv.org/abs/2005.14165 https://arxiv.org/abs/2005.14165) Pages: 21-23, 63

YeGoblynQueenne 6y ago
See my reply above. The evidence in the paper does not support the claim that GPT-3 has learned rules of arithmetic (also claimed in the paper, not just in the OP's comment). There is a much simpler explanation, i.e. memorisation.
- jointpdf 6y ago
  Your reply is misleading, sorry. You didn’t offer any actual evidence of your own to support the memorization claim. You didn’t even do your own arithmetic problem correctly. Since your performance on this task was <100% accurate, I can only assume you do not know the rules of arithmetic. > How many "x + y" questions can be formulated where x and y are both single-digit numbers? The answer is 2^10, or 100. Less snarkily, if there’s (10^4)^2 = 100 million combinations of 4 digit addition problems, and GPT-3 is reaching 25.5% accuracy on those problems (vs. 0.4% in the 13B parameter model). For 3 digit problems, it’s even better: 1 million combinations and 80.4% accuracy. Clearly, there is more happening than simple memorization—the training set does not contain 800k 3-digit addition problems. Thus, it’s fair to say that the model has at least a partial grasp of how to perform arithmetic operations (but probably not fair to say that it has synthesized the entire system of arithmetic). Also, the paper does say that they scrubbed exact examples from the training set to avoid memorization, a fact you left out: > (pg. 23): ”To spot-check whether the model is simply memorizing specific arithmetic problems, we took the 3-digit arithmetic problems in our test set and searched for them in our training data in both the forms "<NUM1> + <NUM2> =" and "<NUM1> plus <NUM2>". Out of 2,000 addition problems we found only 17 matches (0.8%) and out of 2,000 subtraction problems we found only 2 matches (0.1%), suggesting that only a trivial fraction of the correct answers could have been memorized. In addition, inspection of incorrect answers reveals that the model often makes mistakes such as not carrying a “1”, suggesting it is actually attempting to perform the relevant computation rather than memorizing a table.”