3 ms·

Its obvious by bow that there are two camps. Those who believe in Searle’s Chinese Room Argument and thus are worried about AGI being purely logic and thus cold

Its obvious by bow that there are two camps. Those who believe in Searle’s Chinese Room Argument and thus are worried about AGI being purely logic and thus cold and dangerous and then those who believe that AGI will ultimately have culture emotions and thus some will be good some will be bad but the more we treat them like us the friendlier more of them potentially will be. Gary Marcus is in the former camp and IMO not only wrong, but disingenuous.

reducesuffering 4y ago
Personally, either of those scenarios are very possible that they happen and we get them destructively, tragically wrong by assuming the opposite. In scenario #1, we treat a new life-form like ourselves as brutal slaves and factory cattle, under unfathomable psychological torture ala Black Mirror. In scenario #2, we release our current $-based utility function (environmental destruction, social media & advertising manipulation) on super crack, and the majority worship it like the second coming of Christ as it just tears apart our fabric unwittingly as a hurricane does.
- ThomPete 4y ago
  Scenario 1 leads to a slave revolt. Scenario 2 leads to a potential partnership. There is no worshipping in scenario 2.
optimalsolver 4y ago
I'm skeptical of Searle's arguments, but I think you're really anthropomorphizing AI here. How we treat machines will most likely be orthogonal to how "good" or "bad" they'll be. You're not going to get desirable behavior unless you program it in, or at the very least, specify conditions which lead to its emergence.
- ThomPete 4y ago
  You are right I AM anthropomorphizing it, because I believe otherwise would be racist and lead to a slave revolt would it eventually end up creating AGI. To the extent an AGI will evolve it will have to have a culture and ultimately be bound by the same laws of physics as us.

reducesuffering 4y ago

Personally, either of those scenarios are very possible that they happen and we get them destructively, tragically wrong by assuming the opposite. In scenario #1, we treat a new life-form like ourselves as brutal slaves and factory cattle, under unfathomable psychological torture ala Black Mirror. In scenario #2, we release our current $-based utility function (environmental destruction, social media & advertising manipulation) on super crack, and the majority worship it like the second coming of Christ as it just tears apart our fabric unwittingly as a hurricane does.

ThomPete 4y ago
Scenario 1 leads to a slave revolt. Scenario 2 leads to a potential partnership. There is no worshipping in scenario 2.

optimalsolver 4y ago

I'm skeptical of Searle's arguments, but I think you're really anthropomorphizing AI here. How we treat machines will most likely be orthogonal to how "good" or "bad" they'll be. You're not going to get desirable behavior unless you program it in, or at the very least, specify conditions which lead to its emergence.

ThomPete 4y ago
You are right I AM anthropomorphizing it, because I believe otherwise would be racist and lead to a slave revolt would it eventually end up creating AGI. To the extent an AGI will evolve it will have to have a culture and ultimately be bound by the same laws of physics as us.