It's arrogant to think that any kind of QA could prevent how an AI would turn out. That's probably why the terminators took over humans in the movie--because hu

It's arrogant to think that any kind of QA could prevent how an AI would turn out. That's probably why the terminators took over humans in the movie--because humans were arrogant enough to think that doing enough QA would prevent everything. What should happen instead is you need to be humble and assume that things won't go the way you designed them to, that's the "safe" way to build AIs in the long term. The OP uses the "repeat after me" feature as the QA fail, but he's overlooking how it could have gone wrong in many other ways even if they didn't have that problem. No matter how robust system you build there always will be hackers who try to manipulate it (in fact it's more satisfying to hack a robust system than brittle one)