5 ms·
Intelligence creates tools--that is its nature. Modifying intelligence is easy--just fork a process--now you have two minds working on the problem. I'm human a
by ericb 14y ago
Intelligence creates tools--that is its nature. Modifying intelligence is easy--just fork a process--now you have two minds working on the problem. I'm human and I could hack into other machines to gain their processing power. Even if you don't put it on the web, it could probably talk you or someone in the lab to do so by promising stock market riches, or to cure the janitor's kid of cancer. All of these things would be behaviors that further the paperclip goal.
- andrewflnr 14y agoYou can't directly modify your intelligence. You can only do so indirectly using tools made possible by the physics in which you are embedded. Why assume that the framework around the AI is more permissive? Forking a process, initially anyway, only means that two identical minds are working on the problem at half-speed. And I was, in fact, considering "AI in a box"-style scenarios. My point remains: it would be a very impressive AI that could break out. Presumably it at least needs some significant basic resources, memory at least, and CPU to do it in reasonable time, to do deep human-hacking. How can it convince us to give them to it if it doesn't have them to begin with? If we're assuming we can control its goals at all (if we can't we're already doomed by virtue of trying), will it even occur to the thing to act beyond giving direct instructions to humans? Will it have enough concept of self to conceive of escaping, to say "I think therefore I am"? Can it even realize what kinds of computational resources it needs and how to ask for them? There may be good answers to these questions, but I don't believe they're trivial.