> what if the AI is perfectly friendly? It still might play us for fools... "Friendly" is a term of art among AI people, at least at Less Wrong, and their mean

> what if the AI is perfectly friendly? It still might play us for fools... "Friendly" is a term of art among AI people, at least at Less Wrong, and their meaning of friendly excludes this whole scenario. A friendly AI is one which helps humanity and has no horrifying side effects. The vagueness of that definition is the problem Yudkowsky and his acolytes are trying to solve.