4 ms·

A Terminator Skynet scenario is currently playing out in my head. I wonder how long after this human brain simulation runs it takes for it to become self aware

A Terminator Skynet scenario is currently playing out in my head. I wonder how long after this human brain simulation runs it takes for it to become self aware and starts attacking us? In all seriousness, if this works this could potentially unlock so many mysteries and help solve & understand a plethora of medical issues like mental illness. We are living in extraordinary times.

munin 14y ago
if a brain in a box becomes sentient, its attempts to "attack" us would probably look a lot like this: http://www.smbc-comics.com/index.php?db=comics&id=1847 http://www.smbc-comics.com/index.php?db=comics&id=1847
AndrewKemendo 14y ago
I wish this meme would die. It really just taints everything we are trying to do with Strong AI.
- scaphandre 14y ago
  Do you have any proof that Strong AI would be safe for humans?
  - Jach 14y ago
    The default outcome for AGI is likely bad (http://singularity.org/files/ComplexValues.pdf http://singularity.org/files/ComplexValues.pdf and http://singularity.org/files/SaME.pdf http://singularity.org/files/SaME.pdf), but not in the ridiculous way that movies portray it, and no one should be using the movies as a substitute for thought (http://lesswrong.com/lw/k9/the_logical_fallacy_of_generalization_from/ http://lesswrong.com/lw/k9/the_logical_fallacy_of_generaliza...). There are so many types of AI minds, and so many ways for it to go wrong (http://wiki.lesswrong.com/wiki/Paperclip_maximizer http://wiki.lesswrong.com/wiki/Paperclip_maximizer) that picking out a very particular fictional one to stress over, make movies about, and attempt to constrain (even framing it as a constraint problem of some more "primitive" desire to destroy humanity) as the only default mind, is pretty silly.
  - psteyn 14y ago
    There's an idea that a Strong AI won't be hostile to humans, due to not being mortal as we are. It has no need to be emotional, jealous or hateful. The idea as that these feelings are due to our own mortality and fragility. Why would an advanced, technically immortal, machine want to hurt us at all? You are humanizing it by thinking so.
  - wookietrader 14y ago
    Not sure why this being downvoted. Provably friendly strong AI is actually sth that researcher care about, yet it is difficult to do because "friendly" has to be defined.

munin 14y ago

if a brain in a box becomes sentient, its attempts to "attack" us would probably look a lot like this: http://www.smbc-comics.com/index.php?db=comics&id=1847 http://www.smbc-comics.com/index.php?db=comics&id=1847

AndrewKemendo 14y ago

I wish this meme would die. It really just taints everything we are trying to do with Strong AI.

scaphandre 14y ago
Do you have any proof that Strong AI would be safe for humans?
- Jach 14y ago
  The default outcome for AGI is likely bad (http://singularity.org/files/ComplexValues.pdf http://singularity.org/files/ComplexValues.pdf and http://singularity.org/files/SaME.pdf http://singularity.org/files/SaME.pdf), but not in the ridiculous way that movies portray it, and no one should be using the movies as a substitute for thought (http://lesswrong.com/lw/k9/the_logical_fallacy_of_generalization_from/ http://lesswrong.com/lw/k9/the_logical_fallacy_of_generaliza...). There are so many types of AI minds, and so many ways for it to go wrong (http://wiki.lesswrong.com/wiki/Paperclip_maximizer http://wiki.lesswrong.com/wiki/Paperclip_maximizer) that picking out a very particular fictional one to stress over, make movies about, and attempt to constrain (even framing it as a constraint problem of some more "primitive" desire to destroy humanity) as the only default mind, is pretty silly.
- psteyn 14y ago
  There's an idea that a Strong AI won't be hostile to humans, due to not being mortal as we are. It has no need to be emotional, jealous or hateful. The idea as that these feelings are due to our own mortality and fragility. Why would an advanced, technically immortal, machine want to hurt us at all? You are humanizing it by thinking so.
- wookietrader 14y ago
  Not sure why this being downvoted. Provably friendly strong AI is actually sth that researcher care about, yet it is difficult to do because "friendly" has to be defined.