3 ms·
A true AI can solve problems that you haven't explicitly designed it to solve. It doesn't necessarily have any "desire" to solve those problems or any kind of s
by zaroth 12y ago
A true AI can solve problems that you haven't explicitly designed it to solve. It doesn't necessarily have any "desire" to solve those problems or any kind of survival instinct. It doesn't necessarily "care" about solving the problem or "want" to solving increasingly difficult problems. A strong AI doesn't necessarily ponder its own existence.
Being immortal also means there's no reason to care about these things.
I assume an AGI will be able to communicate fluently with humans and answer questions and solve problems that are properly presented. I think the trick will be fully explaining the constraints of a desired solution since even a powerful problem-solving AGI might not have human intuition about the "right" way problems should be solved.
- pron 12y agoBut you're making an assumption that "being able to solve problems you weren't designed to solve" is an ability that's orthogonal to desire, and that seems like a rather strong assumption, given that the only example we have of a being capable of solving such problems also has what we call free will, and so far we haven't been able to isolate separate mechanisms responsible for each. And AI will, of course, be mortal as it can be killed, and can at best hope to live as long as this planet/solar system/galaxy/universe. But even if it were immortal (I don't see how, but suppose), I don't think we have any idea what an immortal being cares about. So far, all the immortal entities we've imagined care about quite a lot of things.