5 ms·

Eventually the headline will be the first 2 words. The tech is neat, there is value in a sense, LLMs are a fun tech. They are not going to invent AGI with LLMs

by dgfitz 2y ago

Eventually the headline will be the first 2 words. The tech is neat, there is value in a sense, LLMs are a fun tech. They are not going to invent AGI with LLMs.

wilg 2y ago
who cares if they do it with LLMs or not? how do you define agi?
- dgfitz 2y ago
  … very carefully?
- goatlover 2y ago
  Whatever makes Open AI enough money?
- mschuster91 2y ago
  > how do you define agi? An AI that has enough sense of self-awareness to not hallucinate and to recognize the borders of its knowledge on its own. That is fundamentally impossible to do with LLMs because in the end, they are all next-token predictors while humans are capable of a much more complex model of storing and associating information and context, and most importantly, develop "mental models" from that information and context. And anyway, there are other tasks than text generation. Take autonomous driving for example - a driver of a car sees a person attempting to cross a street in front of them. A human can decide to slam the brake or the gas depending on the context - is the person crossing the car some old granny on a walker or a soccer player? Or a human sees a ball being kicked into the air on the sidewalk behind some cars, with no humans visible. The human can infer "whoops, there might be children playing here, better slow down and be prepared for a child to suddenly step out onto the street from between the cars", but an object detection/classification lacks that ability to even recognize the ball as being a potentially relevant piece of context.
  - PittleyDunkin 2y ago
    > An AI that has enough sense of self-awareness to not hallucinate It's not entirely clear that this is meaningful. Humans engage in confabulation, too.
    - onemoresoop 2y ago
      Humans engage in confabulation but they’re mostly aware of it. In some mental disorders they may not be aware; though statistically that is not too significant and no, we normally don’t confabulate as much as the current crop of AI aka LLMs. As a tool LLMs are fantastic and am glad to look at them as solely as powerful tools. AGI is not here yet and maybe that’s a good thing. Who would want some kind of artificial intelligence that is capable of understanding us, that is capable of using psychological tricks on people, that could have different goals than us and so on.
      - wilg 2y ago
        https://www.medicalnewstoday.com/articles/confabulation#vs-lying https://www.medicalnewstoday.com/articles/confabulation#vs-l... > Confabulators are usually unaware they are providing false information. They often display genuine surprise or confusion when evidence of facts contradicts their statements. This is similar to LLMs actually. But it also seems like various "System 2" things like chain of thought could compensate for this issue in the LLM (and that possibly that is similar to how the brain works).
      - PittleyDunkin 2y ago
        > Humans engage in confabulation but they’re mostly aware of it. I'm not sure this is the case at all. Some awareness of this doesn't imply full awareness. In my experience, most people are unaware of how incoherent their worldviews are, so the distinction between normative and confabulatory behavior isn't clear.
  - wilg 2y ago
    again i don't care whether its done with an LLM or not. there's no reason to think openai will only build LLMs. recognizing borders of its knowledge is a reasonable thing to include in an agi definition i suppose, but does not seem intractable. for the second one, ai drivers like tesla's current version is already skipping the object detection/classification and instead uses deep learning on the entire video frame and could absolutely use the ball or any other context to change behavior, even without the particular internal monologue describe there.
- portaouflop 2y ago
  We have this discussion every minute -.-
- lm28469 2y ago
  I care because it's brought to us by same same deranged brains who promised self driving cars "in two years" every year since 2012, and a fully autonomous mars city "by 2030". We're all wasting time and resources on what basically amounts to alchemy while we could tackle real problems. Tech solutionists keep making promises for the next 5-10-20 years and never deliver, AI, electric planes, clean fuel, autonomous cars, the meta verse, brain implents. You'd expect the internet would have made people smarter but we fall for the same snake oil as 100 years ago, en masse this time
  - wilg 2y ago
    i mean there’s progress on all those things and that’s good and there’s no downside really?

by dgfitz 2y ago

Eventually the headline will be the first 2 words. The tech is neat, there is value in a sense, LLMs are a fun tech. They are not going to invent AGI with LLMs.

wilg 2y ago

who cares if they do it with LLMs or not? how do you define agi?

dgfitz 2y ago
… very carefully?
goatlover 2y ago
Whatever makes Open AI enough money?
mschuster91 2y ago
> how do you define agi? An AI that has enough sense of self-awareness to not hallucinate and to recognize the borders of its knowledge on its own. That is fundamentally impossible to do with LLMs because in the end, they are all next-token predictors while humans are capable of a much more complex model of storing and associating information and context, and most importantly, develop "mental models" from that information and context. And anyway, there are other tasks than text generation. Take autonomous driving for example - a driver of a car sees a person attempting to cross a street in front of them. A human can decide to slam the brake or the gas depending on the context - is the person crossing the car some old granny on a walker or a soccer player? Or a human sees a ball being kicked into the air on the sidewalk behind some cars, with no humans visible. The human can infer "whoops, there might be children playing here, better slow down and be prepared for a child to suddenly step out onto the street from between the cars", but an object detection/classification lacks that ability to even recognize the ball as being a potentially relevant piece of context.
- PittleyDunkin 2y ago
  > An AI that has enough sense of self-awareness to not hallucinate It's not entirely clear that this is meaningful. Humans engage in confabulation, too.
  - onemoresoop 2y ago
    Humans engage in confabulation but they’re mostly aware of it. In some mental disorders they may not be aware; though statistically that is not too significant and no, we normally don’t confabulate as much as the current crop of AI aka LLMs. As a tool LLMs are fantastic and am glad to look at them as solely as powerful tools. AGI is not here yet and maybe that’s a good thing. Who would want some kind of artificial intelligence that is capable of understanding us, that is capable of using psychological tricks on people, that could have different goals than us and so on.
    - wilg 2y ago
      https://www.medicalnewstoday.com/articles/confabulation#vs-lying https://www.medicalnewstoday.com/articles/confabulation#vs-l... > Confabulators are usually unaware they are providing false information. They often display genuine surprise or confusion when evidence of facts contradicts their statements. This is similar to LLMs actually. But it also seems like various "System 2" things like chain of thought could compensate for this issue in the LLM (and that possibly that is similar to how the brain works).
    - PittleyDunkin 2y ago
      > Humans engage in confabulation but they’re mostly aware of it. I'm not sure this is the case at all. Some awareness of this doesn't imply full awareness. In my experience, most people are unaware of how incoherent their worldviews are, so the distinction between normative and confabulatory behavior isn't clear.
- wilg 2y ago
  again i don't care whether its done with an LLM or not. there's no reason to think openai will only build LLMs. recognizing borders of its knowledge is a reasonable thing to include in an agi definition i suppose, but does not seem intractable. for the second one, ai drivers like tesla's current version is already skipping the object detection/classification and instead uses deep learning on the entire video frame and could absolutely use the ball or any other context to change behavior, even without the particular internal monologue describe there.
portaouflop 2y ago
We have this discussion every minute -.-
lm28469 2y ago
I care because it's brought to us by same same deranged brains who promised self driving cars "in two years" every year since 2012, and a fully autonomous mars city "by 2030". We're all wasting time and resources on what basically amounts to alchemy while we could tackle real problems. Tech solutionists keep making promises for the next 5-10-20 years and never deliver, AI, electric planes, clean fuel, autonomous cars, the meta verse, brain implents. You'd expect the internet would have made people smarter but we fall for the same snake oil as 100 years ago, en masse this time
- wilg 2y ago
  i mean there’s progress on all those things and that’s good and there’s no downside really?