7 ms·

OpenAI expects GPT-5 to achieve AGI

14 points by baal80spam 4y ago

xg15 4y ago
Well yes, that's nice and all, but on the other hand so vague that I wonder if it wouldn't qualify for HN's "announcement of an announcement" rule. OP has been told that some people within OpenAI believe that once GPT-5 is there, it will totally reach AGI! Or we'll at least debate about it!
gitfan86 4y ago
AGI has been here since AlphaGO. Humans were just bad at understanding the nature of intelligence. What is happening now and will continue for a few years is rewriting the definition of AGI by the luddites. They will keep moving the goal posts.
- dmm 4y ago
  > rewriting the definition of AGI by the luddites. The Luddites were a group of working class people whose livelihoods were destroyed by the invention of the Jacquard loom. They were eventually suppressed with government violence. If your comparison is accurate, they really should be worried!
- Turskarama 4y ago
  And what definition of AGI are _you_ using? The G in AGI stands for General. Can AlphaGo do anything other than play Go really well? If not, it is by no means general.
  - gitfan86 4y ago
    If you put a Go Board in front of a human who was raised by wolves in the jungle, would he play it? Or would you have to train him on how to play it? Would he not be generally intelligent if he didn't know how to play go with zero training?
    - xuhu 4y ago
      As the saying goes, you can teach a kid from the jungle to play Go, but you can't teach a an AI that plays Go to live in the jungle.
      - catchnear4321 4y ago
        Right, no disagreement, that all makes sense. (Also my favorite saying as of reading it.) But if Mowgli takes the glowing orb with a funny voice into the jungle with a Go board because the glowing orb tells him to…
  - threatofrain 4y ago
    I think a good definition is causal learning with analogical mapping (generalization). This is something we expect out of rats, ravens, and dogs.
  - candiodari 4y ago
    Well, AlphaZero has all the Go assumptions removed (which were not many, they put it out very quickly)
spicyusername 4y ago
Company with financial interest in stoking hysteria for their products continues to stoke hysteria. It's so wild to watch a hype cycle like this in real time. These tools are amazing, but the hype around them is even more incredible than the technology.
IdiocyInAction 4y ago
> *also to be clear I don’t mean to say achieving agi with gpt5 is a consensus belief within openai, but non zero people there believe it will get there. Uh, that's burying the lede to say the least. "Non-zero" could mean one person.
- beanbean01 4y ago
  Yeah, I think he's just making this up and this is his opinion. Later down he says "someone who didn't; (source, I made it up reaction image)". And I'm thinking: if you have to pointedly say that it's not made up, it's probably made up. For what it's worth, there's an interview slightly farther down in which Altman says that he does not think GPT-5 will achieve AGI, and that no GPT will, likely, because he thinks an AGI needs some degree of autonomy and "want".
zeeed 4y ago
No, OpenAI does not expect this, the CEO can be heard here https://youtu.be/to78maCxFEs https://youtu.be/to78maCxFEs
spapas82 4y ago
Either I don't understand what AGI is or openai doesn't understand what AGI is. Because of the way gpt 3,4,5 or even 1000 works it can't be possible for AGI to be achieved. How could we say that we've got AGI when the "intelligence" is a synthesis of existing knowledge, without even ever understanding what it means? If real AGI is to be achieved it can only be through a completely different paradigm (don't ask me which) definitely not through machine learning. My opinion is that this whole machine learning thing will make achieving AGI even more difficult since most resources have switched their focus on that instead of trying to achieve real artificial intelligence (if that's even possible anyway).
- beanbean01 4y ago
  "OpenAI" does not believe that it will be AGI. There is an interview farther down in the thread in which Altman states that A) GPT-5 will not be AGI and B) the GPT paradigm likely has some fundamental problems which will not get it to AGI, and that if a GPT becomes AGI it is far off. Later down, Siqi clarifies several things: 1. That he believes AGI is a continuum, and encompasses most stuff that isn't a narrow system. So what he is ACTUALLY saying is "GPT-5 is not a narrow system, and is near the bottom of the AGI continuum". 2. That this is NOT a consensus belief within OpenAI, but rather one only shared by a "non-zero number". This should be a BIG RED WARNING SIGN, because it likely means that the number is very low and he is puffing it up/twisting words. 3. Seeing as he went on to actively deny that it was from someone making it up, that means that it's likely this is just his opinion and maybe a few of his friends. 4. He went on to answer the "agency" question by stating that one could attach a goal loop to it. So a prototype paperclip maximizer. Greeeeeeat. And regarding ASI ... seeing the destruction and stupidity that an overgrown autocomplete can cause, maybe, just maybe, it's a good thing if we aren't on track for that right now.
- haffi112 4y ago
  You may have an opinion, but can you justify why you don't believe chatGPT will achieve AGI? Existing scaling laws show that perplexity (i.e., ability to predict next tokens in text) can be lowered by increasing model size and adding more data. Why would a model that is better than us at predicting what words would occur next in arbitrary text not be an AGI?
brodouevencode 4y ago
I just don’t see it. 3 and now 4 just seem to be an eloquent search engine. It cannot perform any sort of actual critical thinking, just regurgitation of its models.
slowmovintarget 4y ago
Step 1: Redefine the term to mean something lesser (intelligence without consciousness) Step 2: Declare "Nailed It!" Step 3: Profit? If AGI is mere intelligence (modeling and reasoning, absent motivation), then whatever they call GPT-5 could achieve it. If AGI like the original meaning of the term Artificial Intelligence means a conscious mind like Asimov's R. Daneel Olivaw or even R2D2, then I don't think GPT-5 will get there.
jacknews 4y ago
obvious hysteria but i note that gpt-4 training ended at the end of 2021, yet the model was only released to the public in q1 2023. so i suspect gpt-5 is already running, and being evaluated by 'interested parties'.
Yizahi 4y ago
Chinese room is not AGI. Maybe AGI will be achieved at some point, but not in the next few years.
jgalt212 4y ago
Can it drive a car?
tomohelix 4y ago
I truly believe there is a spark of intelligence in the current crops of LLMs. Probably because I wholeheartedly believe we are nothing but a bunch of neurons pieced together and there is nothing special about human. But man, even I can't take this GPT5 will be AGI seriously. If they still use the LLM with transformer, then it will never be AGI. The transformer can't continuously learn and absorb new information during use. And it sure as hell won't stop hallucinating, imo until it can interact with the actual meatspace using some sorts of sensors and ground itself in our reality somehow. The LLMs can at best be a very knowledgeable man with severe mental issues, probably isolated in a sensory deprivation room for too long. He still can be useful, but don't expect too much from a madman.
- antisthenes 4y ago
  Any computer model that isn't hooked up to outworld sensors that enable human-like senses (touch, smell, vision, etc.) is not and cannot be anything even remotely close to AGI. Pure text models will never have innate understanding of the physical world on a level that rivals human intelligence.
deleted 4y ago
[deleted]
deleted 4y ago
[deleted]

14 points by baal80spam 4y ago

xg15 4y ago

Well yes, that's nice and all, but on the other hand so vague that I wonder if it wouldn't qualify for HN's "announcement of an announcement" rule. OP has been told that some people within OpenAI believe that once GPT-5 is there, it will totally reach AGI! Or we'll at least debate about it!

gitfan86 4y ago

AGI has been here since AlphaGO. Humans were just bad at understanding the nature of intelligence. What is happening now and will continue for a few years is rewriting the definition of AGI by the luddites. They will keep moving the goal posts.

dmm 4y ago
> rewriting the definition of AGI by the luddites. The Luddites were a group of working class people whose livelihoods were destroyed by the invention of the Jacquard loom. They were eventually suppressed with government violence. If your comparison is accurate, they really should be worried!
Turskarama 4y ago
And what definition of AGI are _you_ using? The G in AGI stands for General. Can AlphaGo do anything other than play Go really well? If not, it is by no means general.
- gitfan86 4y ago
  If you put a Go Board in front of a human who was raised by wolves in the jungle, would he play it? Or would you have to train him on how to play it? Would he not be generally intelligent if he didn't know how to play go with zero training?
  - xuhu 4y ago
    As the saying goes, you can teach a kid from the jungle to play Go, but you can't teach a an AI that plays Go to live in the jungle.
    - catchnear4321 4y ago
      Right, no disagreement, that all makes sense. (Also my favorite saying as of reading it.) But if Mowgli takes the glowing orb with a funny voice into the jungle with a Go board because the glowing orb tells him to…
- threatofrain 4y ago
  I think a good definition is causal learning with analogical mapping (generalization). This is something we expect out of rats, ravens, and dogs.
- candiodari 4y ago
  Well, AlphaZero has all the Go assumptions removed (which were not many, they put it out very quickly)

spicyusername 4y ago

Company with financial interest in stoking hysteria for their products continues to stoke hysteria. It's so wild to watch a hype cycle like this in real time. These tools are amazing, but the hype around them is even more incredible than the technology.

IdiocyInAction 4y ago

> *also to be clear I don’t mean to say achieving agi with gpt5 is a consensus belief within openai, but non zero people there believe it will get there. Uh, that's burying the lede to say the least. "Non-zero" could mean one person.

beanbean01 4y ago
Yeah, I think he's just making this up and this is his opinion. Later down he says "someone who didn't; (source, I made it up reaction image)". And I'm thinking: if you have to pointedly say that it's not made up, it's probably made up. For what it's worth, there's an interview slightly farther down in which Altman says that he does not think GPT-5 will achieve AGI, and that no GPT will, likely, because he thinks an AGI needs some degree of autonomy and "want".

zeeed 4y ago

No, OpenAI does not expect this, the CEO can be heard here https://youtu.be/to78maCxFEs https://youtu.be/to78maCxFEs

spapas82 4y ago

Either I don't understand what AGI is or openai doesn't understand what AGI is. Because of the way gpt 3,4,5 or even 1000 works it can't be possible for AGI to be achieved. How could we say that we've got AGI when the "intelligence" is a synthesis of existing knowledge, without even ever understanding what it means? If real AGI is to be achieved it can only be through a completely different paradigm (don't ask me which) definitely not through machine learning. My opinion is that this whole machine learning thing will make achieving AGI even more difficult since most resources have switched their focus on that instead of trying to achieve real artificial intelligence (if that's even possible anyway).

beanbean01 4y ago
"OpenAI" does not believe that it will be AGI. There is an interview farther down in the thread in which Altman states that A) GPT-5 will not be AGI and B) the GPT paradigm likely has some fundamental problems which will not get it to AGI, and that if a GPT becomes AGI it is far off. Later down, Siqi clarifies several things: 1. That he believes AGI is a continuum, and encompasses most stuff that isn't a narrow system. So what he is ACTUALLY saying is "GPT-5 is not a narrow system, and is near the bottom of the AGI continuum". 2. That this is NOT a consensus belief within OpenAI, but rather one only shared by a "non-zero number". This should be a BIG RED WARNING SIGN, because it likely means that the number is very low and he is puffing it up/twisting words. 3. Seeing as he went on to actively deny that it was from someone making it up, that means that it's likely this is just his opinion and maybe a few of his friends. 4. He went on to answer the "agency" question by stating that one could attach a goal loop to it. So a prototype paperclip maximizer. Greeeeeeat. And regarding ASI ... seeing the destruction and stupidity that an overgrown autocomplete can cause, maybe, just maybe, it's a good thing if we aren't on track for that right now.
haffi112 4y ago
You may have an opinion, but can you justify why you don't believe chatGPT will achieve AGI? Existing scaling laws show that perplexity (i.e., ability to predict next tokens in text) can be lowered by increasing model size and adding more data. Why would a model that is better than us at predicting what words would occur next in arbitrary text not be an AGI?

brodouevencode 4y ago

I just don’t see it. 3 and now 4 just seem to be an eloquent search engine. It cannot perform any sort of actual critical thinking, just regurgitation of its models.

slowmovintarget 4y ago

Step 1: Redefine the term to mean something lesser (intelligence without consciousness) Step 2: Declare "Nailed It!" Step 3: Profit? If AGI is mere intelligence (modeling and reasoning, absent motivation), then whatever they call GPT-5 could achieve it. If AGI like the original meaning of the term Artificial Intelligence means a conscious mind like Asimov's R. Daneel Olivaw or even R2D2, then I don't think GPT-5 will get there.

jacknews 4y ago

obvious hysteria but i note that gpt-4 training ended at the end of 2021, yet the model was only released to the public in q1 2023. so i suspect gpt-5 is already running, and being evaluated by 'interested parties'.

Yizahi 4y ago

Chinese room is not AGI. Maybe AGI will be achieved at some point, but not in the next few years.

jgalt212 4y ago

Can it drive a car?

tomohelix 4y ago

I truly believe there is a spark of intelligence in the current crops of LLMs. Probably because I wholeheartedly believe we are nothing but a bunch of neurons pieced together and there is nothing special about human. But man, even I can't take this GPT5 will be AGI seriously. If they still use the LLM with transformer, then it will never be AGI. The transformer can't continuously learn and absorb new information during use. And it sure as hell won't stop hallucinating, imo until it can interact with the actual meatspace using some sorts of sensors and ground itself in our reality somehow. The LLMs can at best be a very knowledgeable man with severe mental issues, probably isolated in a sensory deprivation room for too long. He still can be useful, but don't expect too much from a madman.

antisthenes 4y ago
Any computer model that isn't hooked up to outworld sensors that enable human-like senses (touch, smell, vision, etc.) is not and cannot be anything even remotely close to AGI. Pure text models will never have innate understanding of the physical world on a level that rivals human intelligence.

deleted 4y ago

[deleted]

deleted 4y ago

[deleted]