3 ms·
> An AI is essentially a program, and it does what it was programmed for. Any basis for assuming that we are not "essentially a program" that "does what it was
by vidarh 10y ago
> An AI is essentially a program, and it does what it was programmed for.
Any basis for assuming that we are not "essentially a program" that "does what it was programmed for"?
Being "a program" does not mean something does not have capacity for doing something unexpected. Without being programmed to mimic a human mind.
Case in point: I have some tools that use even just basic bayesian models, and they produce all kinds of unexpected behaviour all the time, because the very nature of it is that they are used to create rules from unstructured data that cause all kinds of unintended effects.
With a sufficiently advanced set of tools, there is every potential that just one small mistake will "set it lose" in an unintended way because more and more of our tools will include learning behaviours and little gleams of intelligence and adaptability.
Consider that it doesn't take intelligence to cause destruction and disruption. Look at the Morris Worm for example. There was not a hint of learning behaviour or intelligence there - imagine if there had been.
In some ways, a "dumb AI" is even more terrifying, because a lot of really nasty things can be achieved with sheer persistance and speed, and requires very little intelligence, and more intelligence might get the entity to realise it's not a good thing to do.
A program mimicing a human mind - or better - might be capable of more destruction, but is also potentially possible to argue, negotiate and plead with.