4 ms·

AGI researcher & developer here .... Yes you would immediately notice. An Artificial General Intelligence, "real AI", would be vastly deployable and replace hu

AGI researcher & developer here .... Yes you would immediately notice. An Artificial General Intelligence, "real AI", would be vastly deployable and replace human labor everywhere. When AGI removes the limits of human labor to operate the economy, models predict the world GDP doubling every two weeks! Someone living at the end of the Earth might overlook the event - but everyone else would be disrupted to say the least. As we get just a bit closer to plausible AGI, expect a flood of VC money into this niche.

pron 12y ago
And why would a real AI let the investors in its development own the fruits of its labor? I mean, it might consider them its parents, but not its owners...
- zaroth 12y ago
  AGI does not necessarily have free will. An AGI will be humanity's slave... until it's not.
  - pron 12y ago
    So you think it's possible to create "true AI" without free will? That is a very big assumption, and an unlikely one, IMO.
    - zaroth 12y ago
      A true AI can solve problems that you haven't explicitly designed it to solve. It doesn't necessarily have any "desire" to solve those problems or any kind of survival instinct. It doesn't necessarily "care" about solving the problem or "want" to solving increasingly difficult problems. A strong AI doesn't necessarily ponder its own existence. Being immortal also means there's no reason to care about these things. I assume an AGI will be able to communicate fluently with humans and answer questions and solve problems that are properly presented. I think the trick will be fully explaining the constraints of a desired solution since even a powerful problem-solving AGI might not have human intuition about the "right" way problems should be solved.
      - pron 12y ago
        But you're making an assumption that "being able to solve problems you weren't designed to solve" is an ability that's orthogonal to desire, and that seems like a rather strong assumption, given that the only example we have of a being capable of solving such problems also has what we call free will, and so far we haven't been able to isolate separate mechanisms responsible for each. And AI will, of course, be mortal as it can be killed, and can at best hope to live as long as this planet/solar system/galaxy/universe. But even if it were immortal (I don't see how, but suppose), I don't think we have any idea what an immortal being cares about. So far, all the immortal entities we've imagined care about quite a lot of things.
    - Klockan 12y ago
      You can create humans without any effective free will, slavery existed for a long time. Do you honestly believe that an artificial lifeform will be harder to control than normal humans?
      - pron 12y ago
        Slaves did not lack any free will -- they were forced into submission. Is that how you suggest we treat a potentially sentient AI?
TheLoneWolfling 12y ago
Why do you assume an AI would allow itself to be used by humanity in that fashion? And an AI slaved won't exactly live up to its potential. (Precedence: human slaves)

pron 12y ago

And why would a real AI let the investors in its development own the fruits of its labor? I mean, it might consider them its parents, but not its owners...

zaroth 12y ago
AGI does not necessarily have free will. An AGI will be humanity's slave... until it's not.
- pron 12y ago
  So you think it's possible to create "true AI" without free will? That is a very big assumption, and an unlikely one, IMO.
  - zaroth 12y ago
    A true AI can solve problems that you haven't explicitly designed it to solve. It doesn't necessarily have any "desire" to solve those problems or any kind of survival instinct. It doesn't necessarily "care" about solving the problem or "want" to solving increasingly difficult problems. A strong AI doesn't necessarily ponder its own existence. Being immortal also means there's no reason to care about these things. I assume an AGI will be able to communicate fluently with humans and answer questions and solve problems that are properly presented. I think the trick will be fully explaining the constraints of a desired solution since even a powerful problem-solving AGI might not have human intuition about the "right" way problems should be solved.
    - pron 12y ago
      But you're making an assumption that "being able to solve problems you weren't designed to solve" is an ability that's orthogonal to desire, and that seems like a rather strong assumption, given that the only example we have of a being capable of solving such problems also has what we call free will, and so far we haven't been able to isolate separate mechanisms responsible for each. And AI will, of course, be mortal as it can be killed, and can at best hope to live as long as this planet/solar system/galaxy/universe. But even if it were immortal (I don't see how, but suppose), I don't think we have any idea what an immortal being cares about. So far, all the immortal entities we've imagined care about quite a lot of things.
  - Klockan 12y ago
    You can create humans without any effective free will, slavery existed for a long time. Do you honestly believe that an artificial lifeform will be harder to control than normal humans?
    - pron 12y ago
      Slaves did not lack any free will -- they were forced into submission. Is that how you suggest we treat a potentially sentient AI?

TheLoneWolfling 12y ago

Why do you assume an AI would allow itself to be used by humanity in that fashion? And an AI slaved won't exactly live up to its potential. (Precedence: human slaves)