4 ms·
I think it's important to realize that AI doesn't have to have bad intent to do us harm. Al it need for AI to have horrible consequences is for us to rely on i
by ThomPete 12y ago
I think it's important to realize that AI doesn't have to have bad intent to do us harm.
Al it need for AI to have horrible consequences is for us to rely on it more and more and thus allow it to control more and more parts of our lives.
I don't fear the human level intelligent AI I fear the rat level intelligence that comes before.
- bad_user 12y agoIt's worse than that - human-like intelligence will never happen, because our intelligence is a function of our experience as we grow up and our human body. An AI can surely surpass us, but it'll never be quite like us - so question is, will such an AI have compassion for humans, or what will stop it from hurting us? After all, I'm not so fond of humans either, as we've been exterminating entire species and damaging our habitat. And the answer is - there's no reason to believe that such an AI will support the continued existence of mankind, quite the contrary, as we may be seen as a threat to its survival.
- therealdrag0 12y agoWhy treat AI like a single thing? Wouldn't the openness of code lead to a plethora of AI with different demeanors, towards humans, life, and each other?
- vertex-four 12y agoWe don't have a reasonable open web search engine - what leads you to think it's definite that we'll have a top-of-the-range open AI?
- therealdrag0 12y agoI don't think it's definite at all; I'm just remarking in a conversation of speculation.
- bad_user 12y agoI don't think so. If we are speaking of an AI that is self-aware, then code will have as much to do with its behavior as our own DNA. I also think that even if multiple AIs happen, they'll converge into a single one. If we would be able to connect to other people's feelings and thoughts, would we would still be able to think and act as individuals? I don't think so. This is what I meant above - an AI will not grow in a human body to have a human-like childhood, will not receive input from the same sensors we have and will not have the same limitations that we do. For example, contrary to us, it will have an enormous memory capacity, which is interesting if you think about it, because for the human brain forgetfulness can be seen as a feature.
- therealdrag0 12y agoI agree that it wouldn't be shaped by a childhood, but I think it merging into one is entirely optional. "code will have as much to do with its behavior as our own DNA." That's what I was saying, and that can be changed to be significantly different just by changing the code.
- JoeAltmaier 12y agoRight; many moral dilemmas are easy to solve if you have no conscience. 10 people on the tracks? switch the engine to run over one child.
- deleted 12y ago[deleted]
- anigbrowl 12y agoMoral dilemmas are easy to solve if you have perfect information. In the train-track problem you reference, the utility of saving 10 people at the expense of 1 life is obvious and I would do so without hesitation (though not without regret). But life rarely presents us with cases where the utilitarian calculus is so clear; our powers of foresight and analysis are so limited that we get better results by establishing and promulgating rules that cover the most common situations - imperfectly, but with tolerably low error levels.
- defen 12y ago> In the train-track problem you reference, the utility of saving 10 people at the expense of 1 life is obvious and I would do so without hesitation (though not without regret) Even if it were your own child?
- sp332 12y agoEven if the answer is no, how does that relate to anigbrowl's point? (or were you just curious?)
- defen 12y agoFrom a "purely utilitarian" perspective your relation to the people involved is not relevant. That's assuming the existence of some "universal" utility, not one specific to the person deciding.
- anigbrowl 12y agoThat's an entirely different problem, though, since I have a selfish interest in preserving my own lineage at the expense of others'. It's an interesting moral problem - just how many people's lives would I be willing to sacrifice to save a member of my own family? - but orthogonal to the point I was making.
- kolev 12y agoI am talking about AI for problem solving, not giving it control via robotics and other means over the physical world.
- ThomPete 12y agoI honestly don't think you can separate that. Problem solving is also making AI control an anti missile defence shield our nuclear reactors, food production and so on.
- anigbrowl 12y agoAn AI in a box is only going to be as good as the problem statements and axioms that you load it up with. What you actually want is an AI that can make useful inferences on our behalf, which is going to require some sort of self-concept.