4 ms·

I would categorize sentient AGI as artificial consciousness[1], but I don't see an obvious reason AGI inherently must be conscious or sentient. (In terms of nea

by buu700 1y ago

I would categorize sentient AGI as artificial consciousness[1], but I don't see an obvious reason AGI inherently must be conscious or sentient. (In terms of near-term economic value, non-sentient AGI seems like a more useful invention.) For me, AGI is an AI that I could assign an arbitrarily complex project, and given sufficient compute and permissions, it would succeed at the task as reliably as a competent C-suite human executive. For example, it could accept and execute on instructions to acquire real estate that matches certain requirements, request approvals from the purchasing and legal departments as required, handle government communication and filings as required, construct a widget factory on the property using a fleet of robots, and operate the factory on an ongoing basis while ensuring reliable widget deliveries to distribution partners. Current agentic coding certainly feels like magic, but it's still not that. 1: https://en.wikipedia.org/wiki/Artificial_consciousness https://en.wikipedia.org/wiki/Artificial_consciousness

ACCount37 1y ago
"Consciousness" and "sentience" are terms mired in philosophical bullshit. We do not have an operational definition of either. We have no agreement on what either term really means, and we definitely don't have a test that could be administered to conclusively confirm or rule out "consciousness" or "sentience" in something inhuman. We don't even know for sure if all humans are conscious. What we really have is task specific performance metrics. This generation of AIs is already in the valley between "average human" and "human expert" on many tasks. And the performance of frontier systems keeps improving.
- amanaplanacanal 1y ago
  "Consciousness" seems pretty obvious. The ability to experience qualia. I do it, you do it, my dog does it. I suspect all mammals do it, and I suspect birds do too. There is no evidence any computer program does anything like it. It's "intelligence" I can't define.
  - ACCount37 1y ago
    Oh, so simple. Go measure it then. The definition of "featherless biped" might have more practical merit, because you can at least check for feathers and count limbs touching the ground in a mostly reliable fashion. We have no way to "check for qualia" at all. For all we know, an ECU in a year 2002 Toyota Hilux has it, but 10% of all humans don't.
    - amanaplanacanal 1y ago
      Plenty of things are real that can't be measured, including many physical sensations and emotions. I won't say they are impossible to ever be measured, but we currently have no idea how.
      - ACCount37 1y ago
        If you can't measure it and can't compare it, then for all practical purposes, it does not exist. "Consciousness" might as well not be real. The only real and measurable thing is capabilities.
        amanaplanacanal 1y ago
        Oof. Tell chronic pain patients that their pain doesn't exist. I guess depression doesn't exist either. Or love.

by buu700 1y ago

ACCount37 1y ago

"Consciousness" and "sentience" are terms mired in philosophical bullshit. We do not have an operational definition of either. We have no agreement on what either term really means, and we definitely don't have a test that could be administered to conclusively confirm or rule out "consciousness" or "sentience" in something inhuman. We don't even know for sure if all humans are conscious. What we really have is task specific performance metrics. This generation of AIs is already in the valley between "average human" and "human expert" on many tasks. And the performance of frontier systems keeps improving.

amanaplanacanal 1y ago
"Consciousness" seems pretty obvious. The ability to experience qualia. I do it, you do it, my dog does it. I suspect all mammals do it, and I suspect birds do too. There is no evidence any computer program does anything like it. It's "intelligence" I can't define.
- ACCount37 1y ago
  Oh, so simple. Go measure it then. The definition of "featherless biped" might have more practical merit, because you can at least check for feathers and count limbs touching the ground in a mostly reliable fashion. We have no way to "check for qualia" at all. For all we know, an ECU in a year 2002 Toyota Hilux has it, but 10% of all humans don't.
  - amanaplanacanal 1y ago
    Plenty of things are real that can't be measured, including many physical sensations and emotions. I won't say they are impossible to ever be measured, but we currently have no idea how.
    - ACCount37 1y ago
      If you can't measure it and can't compare it, then for all practical purposes, it does not exist. "Consciousness" might as well not be real. The only real and measurable thing is capabilities.
      - amanaplanacanal 1y ago
        Oof. Tell chronic pain patients that their pain doesn't exist. I guess depression doesn't exist either. Or love.