3 ms·
> Lots of developers here, but also in the media, believe GPT is the precursor for AGI. Which is ridiculous; it's just an incredible token predictor. Its langua
by ben_w 3y ago
> Lots of developers here, but also in the media, believe GPT is the precursor for AGI. Which is ridiculous; it's just an incredible token predictor. Its language capabilities might be useful, but AGI won't be possible without a self-correcting model that can actually reason. Even Altman hinted at that.
I think part of this is that all three letters of the initialism mean different things to different people.
To me? The domain is broad rather than narrow, so it's got the "G" of "AGI".
Definitely agree it is not a complete solution, and thus that reasonable people will say "no Ben this isn't general what are you talking about".
I also definitely agree isn't superhuman, but I think superhuman ability across all of its domain is an unreasonable requirement for AGI and what I would instead call that ASI… but I'm also a linguistic descriptivist, so it doesn't matter if the consensus is unreasonable[0] just what the consensus actually is.
Also: my understanding from "Fine-Tuning Language Models from Human Preferences"[1] (in particular the summary version of the bug, "The True Story of How GPT-2 Became Maximally Lewd"[2]) is that these models are capable of self-correcting behaviour — we just don't do that live because that makes it much harder to research and to use (every time it even seems like the ChatGPT model changes, someone complains).
> But it will keep getting stuck on the accuracy part
I suspect otherwise. Some — not all, but some — domains have easily testable results. In these domains, the generated output can be quickly tested, and used to update the model.
This is already done with human preferences, but I'm thinking more along the lines of a coding assistant which gets feedback from a compiler, or a maths assistant which gets feedback from… maths isn't my field, I'm just going to say MATLAB or the Wolfram Language and hope these are both as highly regarded as Photoshop.
[0] this happens a lot: tautologies such as "ATM machine"; or redefinitions such that "PC" excludes MacOS and all phones and tablets; that Elon Musk can only be called "African-American" by pedants (including me, despite being a descriptivist); exactly how effective and how altruistic is "Effective Altruism" etc.
[1] https://arxiv.org/pdf/1909.08593.pdf https://arxiv.org/pdf/1909.08593.pdf
[2] https://forum.effectivealtruism.org/posts/5mADSy8tNwtsmT3KG/the-true-story-of-how-gpt-2-became-maximally-lewd-1 https://forum.effectivealtruism.org/posts/5mADSy8tNwtsmT3KG/...
- wouldbecouldbe 3y agoBeing superhuman is the defacto definition of AGI leading to singularity, mainly self-correcting is main requirement, and that's why they fear it. If you just change the definition of AGI to what GPT does currently then indeed by your definition it's AGI. But that's not what OpenAI & musk mean with AGI.
- ben_w 3y ago"""Artificial general intelligence (AGI) is a type of artificial intelligence (AI) that can perform as well or better than humans on a wide range of cognitive tasks,[1] as opposed to narrow AI, which is designed for specific tasks.""" - the opening sentence of the Wikipedia page on this. "[A]s well or better" allows "better" without requiring it. I will also note that while OpenAI is indeed clear that their definition of AGI is superhuman[0], this is not a universal position[1]. [0] "(AGI)—by which we mean highly autonomous systems that outperform humans at most economically valuable work" - https://openai.com/charter https://openai.com/charter [1] "The most popular definition of AGI is the ability to perform any intellectual task that a human can do. While highly desirable, this may not align with what’s essential for achieving the singularity." - natanael.wf, Dec 2023, https://community.openai.com/t/agi-is-what-we-want-but-not-what-we-need-for-singularity/571275 https://community.openai.com/t/agi-is-what-we-want-but-not-w...
- wouldbecouldbe 3y agoIt's what we all mean without saying it, because singularity
- ben_w 3y agoGiven all the people you're critisising for saying ChatGPT a precursor to AGI, can we at least agree with my opening line?: > I think part of this is that all three letters of the initialism mean different things to different people. People only look "ridiculous" to you because those who consider AGI synonymous with ASI are doing exactly what you (apparently) don't like me doing: "just chang[ing] the definition of AGI".
- wouldbecouldbe 3y agoNo, because if you read the other comments in this thread you will see lots of people think that human's are just Token generators as well. The might say it with more sophistication at times, but essentially a lot of technoligist are arguing that from an statistical anaylisis alone, conciousness arises if it's complex enough. Okay that's a different debate, but it all gets mingled up.