3 ms·
You can't directly modify your intelligence. You can only do so indirectly using tools made possible by the physics in which you are embedded. Why assume that t
by andrewflnr 14y ago
You can't directly modify your intelligence. You can only do so indirectly using tools made possible by the physics in which you are embedded. Why assume that the framework around the AI is more permissive? Forking a process, initially anyway, only means that two identical minds are working on the problem at half-speed.
And I was, in fact, considering "AI in a box"-style scenarios. My point remains: it would be a very impressive AI that could break out. Presumably it at least needs some significant basic resources, memory at least, and CPU to do it in reasonable time, to do deep human-hacking. How can it convince us to give them to it if it doesn't have them to begin with?
If we're assuming we can control its goals at all (if we can't we're already doomed by virtue of trying), will it even occur to the thing to act beyond giving direct instructions to humans? Will it have enough concept of self to conceive of escaping, to say "I think therefore I am"? Can it even realize what kinds of computational resources it needs and how to ask for them?
There may be good answers to these questions, but I don't believe they're trivial.