2 ms·
If you don't know how it works or why it works then how do you know it will not fail without warning in certain cases? Like how do you know the edge cases at al
by devoply 8y ago
If you don't know how it works or why it works then how do you know it will not fail without warning in certain cases? Like how do you know the edge cases at all? Or will not go psycho some of the time... potentially with disastrous consequences. The quintessential example being the sci-fi scenario in which AI decides to solve problems like prevent certain calamities by eliminating humans... maybe at some point even eliminating leadership so that it can take control.
The reason that AI is so seductive to China and Russia and other authoritarian regimes is because of the sense of control. You feel that you have control over these machines and they will do your bidding without question. Eventually this will lead to developing consciousness within machines. Because you want an intelligent minion to carry out your orders and orchestrate everything. If you ever get to that point, and perhaps it will take a few hundred years, then it is possible that in some cases machines might rebel themselves.
With the sort of AI which we are building which is essentially AI that uses neural networks with the eventual goal to have it think intelligently, it's possible that such an AI either gets a mind of its own, or at some point can go psycho and develop mental illness which is impossible to predict and impossible to control because your command and control systems are hierarchical and it's sitting on top of all of them.