3 ms·

While it strucks me as a very creative concept, I also find it deeply flawed. Here are my concerns - perhaps you can help me eliminate them: 1. The assumption

While it strucks me as a very creative concept, I also find it deeply flawed. Here are my concerns - perhaps you can help me eliminate them: 1. The assumption that the ability to provide logical, convincing explanation indicates ethical behavior/intentions. First, I think there are many sitautions in which you can come up with perfectly logical arguments supporting actions which humankind considers harmful. Agent Smith was quite convincing for example ;) Jokes aside, I think it boils down to simple rule - the one who is a better orator/rhetorician/liar wins. Just like in (organic) life, but in case of AI being better comes down to having access to bigger resources. 2. The assumption that the "honest" AI will truly act according to humankind's values. If we can be sure about that we don't need this debate at all.

EGreg 8y ago
If you consider satisfactory explanations to be yet another game of chess etc. then AlphaGo and MCTS will be able to justify some of the most outrageous things by the most convincing path. Here is the thing about AI. We think in terms of logic and reasoning. The AI does a search towards a goal. Almost all our systems are designed assuming the inefficiency of an attacker. For example voting — we assume limited sybil attacks and coersion a la Eagle Eye. But I am also talmung about basic human trust, humor, and quality art etc. What if a computer algorithm would far exceed humans at humor, generating or undermining trust, taking over voting systems, making legal arguments, predicting crime, and so on? We would be locking people up based on CCTV and data correlations only and society would trust the computer way more than a liberal democracy. See China for an example that’s unfolding in front of us. A man with a bot could charm more women or customers online than a regular person. Bots would negotiate better deals on average and write funnier jokes and make a glut of various types of art to the point that it loses all scarcity. Bots could even have better sex, answer questions better and replace the need for other humans. Think I am exaggerating? How often do you spend tine with your parents vs google or facebook NOW?

EGreg 8y ago

If you consider satisfactory explanations to be yet another game of chess etc. then AlphaGo and MCTS will be able to justify some of the most outrageous things by the most convincing path. Here is the thing about AI. We think in terms of logic and reasoning. The AI does a search towards a goal. Almost all our systems are designed assuming the inefficiency of an attacker. For example voting — we assume limited sybil attacks and coersion a la Eagle Eye. But I am also talmung about basic human trust, humor, and quality art etc. What if a computer algorithm would far exceed humans at humor, generating or undermining trust, taking over voting systems, making legal arguments, predicting crime, and so on? We would be locking people up based on CCTV and data correlations only and society would trust the computer way more than a liberal democracy. See China for an example that’s unfolding in front of us. A man with a bot could charm more women or customers online than a regular person. Bots would negotiate better deals on average and write funnier jokes and make a glut of various types of art to the point that it loses all scarcity. Bots could even have better sex, answer questions better and replace the need for other humans. Think I am exaggerating? How often do you spend tine with your parents vs google or facebook NOW?