3 ms·

This idea that we will end up with some super-AI that for some reason has baked into it our irrational self-preservation instincts is so silly to me. I think on

• goatlover 10y ago
  "The AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else." ~ Eliezer Yudkowsky Skynet scenarios aren't what we should be worried about. It's the possibility of powerful self-improving AI systems which don't share our values because we didn't think things through properly in designing them. It may seem like they behave appropriately when constrained, but once they become smart enough to overcome constraints that apply to human beings, they could act in unanticipated (and undesirable) ways that we didn't consider. That's the challenge of designing a friendly AGI.