3 ms·
Am I the only one who is totally unimpressed by this? So -- someone can convince someone else to let them out of a cell. Ok. Fine. There have been prison breako
by ramanujan 17y ago
Am I the only one who is totally unimpressed by this? So -- someone can convince someone else to let them out of a cell. Ok. Fine. There have been prison breakouts before.
But what does this have to do with a powerful AI vs. a human? Obviously Eliezer was not to his interlocutor as a human is to an animal, even if his partner was really dumb. Moreover, two trials is not a trend. This AI experiment was not a well designed experiment and did not involve an AI.
...and that "two trials" thing is not just a nitpick:
http://lesswrong.com/lw/up/shut_up_and_do_the_impossible/ http://lesswrong.com/lw/up/shut_up_and_do_the_impossible/
So, after investigating to make sure they could afford to lose it, I played another three AI-Box experiments. I won the first, and then lost the next two. And then I called a halt to it. I didn't like the person I turned into when I started to lose.
- jodrellblank 17y agoIt is a disproof by counterexample. People claim that if we couldn't trust a superhuman AI to be free in the world, why don't we just lock it in a box and then ask it about cures for cancer and so on? If we just ask it, and all it can do is talk what harm can it do? They say, all we need to do is say "no" if it asks to be released. This experiment shows that if you can't resist freeing a human locked in a box, you don't stand a chance against an AI.