3 ms·

It's reasonable to claim that scaling up the dataset might not get us to AGI. But I find it unreasonable to say it definitely won't work. How do you / Marcus kn

It's reasonable to claim that scaling up the dataset might not get us to AGI. But I find it unreasonable to say it definitely won't work. How do you / Marcus know this with any certainty?

skissane 4y ago
I think some of ChatGPT's present problems may be due, not to the size of its dataset as such, but rather specific things missing from its training. For example, it will sometimes blatantly contradict itself, but then be unable to see the contradiction or admit to it; instead it will deny it contradicted itself, and give some contradictory nonsense explanation of why it didn't. I think if you gave it more training data around identifying contradictions, admitting to self-contradictions, it might do much better here. Whereas, I wouldn't assume that simply scaling up the volume of training data, without training focused on this specific area, would get you there. Similarly, there are many other issues it has – excessive repetitiveness and verbosity, problems with language pragmatics, etc – where the actual solution may well involve providing it with training data designed to focus on those weakness areas, rather than just further scaling up the quantity of non-targeted training. So, yeah, to me it seems entirely plausible (even likely) that mere raw scale-up is not going to be enough to get us to AGI.
- sharemywin 4y ago
  I think these LLMs have been optimized with Reinforcement Learning from Human Feedback (RLHF) Hard to tell that will add enough to get close to AGI. Google is also working on chain of thought prompting which helps with math and logic problems. https://medium.com/nlplanet/two-minutes-nlp-making-large-language-models-reason-with-chain-of-thought-prompting-401fd3c964d0 https://medium.com/nlplanet/two-minutes-nlp-making-large-lan...
  - lossolo 4y ago
    COT is so yesterday! SOTA is LAMBADA[1] aka backward chaining also from Google, that significantly outperforms chain of thought and select inference in terms of prediction accuracy and proof accuracy. [1] https://arxiv.org/abs/2212.13894 https://arxiv.org/abs/2212.13894
- sitkack 4y ago
  I contradict and repeat myself, much verbose, bad grammar, accidentally the word all the time. Contradictions don't support the argument that ChatGPT is or is not something. It is a language model, not a logical model. You can guide ChatGPT to correct its mistakes and be less verbose. When folks boldly claim ChatGPT cant do X or Y or Z, they ignore that there are now researchers addressing those same issues. ChatGPT has very low spatial awareness, but you can train it. These LLMs are amazing, what does five years from now look like? How hard will it be to get there?

It's reasonable to claim that scaling up the dataset might not get us to AGI. But I find it unreasonable to say it definitely won't work. How do you / Marcus know this with any certainty?

skissane 4y ago

I think some of ChatGPT's present problems may be due, not to the size of its dataset as such, but rather specific things missing from its training. For example, it will sometimes blatantly contradict itself, but then be unable to see the contradiction or admit to it; instead it will deny it contradicted itself, and give some contradictory nonsense explanation of why it didn't. I think if you gave it more training data around identifying contradictions, admitting to self-contradictions, it might do much better here. Whereas, I wouldn't assume that simply scaling up the volume of training data, without training focused on this specific area, would get you there. Similarly, there are many other issues it has – excessive repetitiveness and verbosity, problems with language pragmatics, etc – where the actual solution may well involve providing it with training data designed to focus on those weakness areas, rather than just further scaling up the quantity of non-targeted training. So, yeah, to me it seems entirely plausible (even likely) that mere raw scale-up is not going to be enough to get us to AGI.

sharemywin 4y ago
I think these LLMs have been optimized with Reinforcement Learning from Human Feedback (RLHF) Hard to tell that will add enough to get close to AGI. Google is also working on chain of thought prompting which helps with math and logic problems. https://medium.com/nlplanet/two-minutes-nlp-making-large-language-models-reason-with-chain-of-thought-prompting-401fd3c964d0 https://medium.com/nlplanet/two-minutes-nlp-making-large-lan...
- lossolo 4y ago
  COT is so yesterday! SOTA is LAMBADA[1] aka backward chaining also from Google, that significantly outperforms chain of thought and select inference in terms of prediction accuracy and proof accuracy. [1] https://arxiv.org/abs/2212.13894 https://arxiv.org/abs/2212.13894
sitkack 4y ago
I contradict and repeat myself, much verbose, bad grammar, accidentally the word all the time. Contradictions don't support the argument that ChatGPT is or is not something. It is a language model, not a logical model. You can guide ChatGPT to correct its mistakes and be less verbose. When folks boldly claim ChatGPT cant do X or Y or Z, they ignore that there are now researchers addressing those same issues. ChatGPT has very low spatial awareness, but you can train it. These LLMs are amazing, what does five years from now look like? How hard will it be to get there?