2 ms·
One thing we won’t be able to do is stay in control once the AI’s are created. Getting them to ask us what to do would be like having dogs run a prison - it wou
by danieltillett 11y ago
One thing we won’t be able to do is stay in control once the AI’s are created. Getting them to ask us what to do would be like having dogs run a prison - it would not take the AI’s long to workout exactly how to get us to willingly release them. The locks needs to be ones that not even we have a choice to unlock.
I am not sure it would be desirable to create a limited singularity. If we are not alone in the universe then at some point our singularity will meet another singularity. It would be best to create the most powerful singularity possible. My thinking about the singularity is it is like a crystallization event in supersaturated solution. One tiny seed is able to covert the whole phase of the solution almost instantly from liquid to solid. A singularity will be like this to the universe we currently see.
Of course we could already be inside someone else’s singularity and it might even be likely given the age of the universe. One of the things I would like to see built into our singularity is the preservation of all life and it is quite possible that other singularities have the same interests. If they do and they arrived in our solar system they would keep us around purely because we are life.
- insoluble 11y agoThe crystalisation analogy sounds about right, although it may be limited by the speed of light in its growth. The dog analogy you have described assumes that the demeanor of the singularity were like that of an animal (such as a human). Although this is an option, it is not the only option. Humans act the way they do through those instincts created by natural selection -- where only those creatures that reproduced the most would have their genes persist. Humans come from a long and vicious cycle of evolution, whereas a thinking machine need not, especially if it has nothing to compete with. The most important point of this reply is that the desire for being in control does not whatsoever stem automatically from intelligence or processing ability. A thinking being without instinct would literally do nothing. A being does exactly as it is programmed to, and this applies to humans as well. There are even some humans who let their pets control them, tending to the pet's every need, and this is despite all that natural selection. There are also humans who kill themselves. Now, none of this is to discount that a singularity could certainly be programmed to want control, wherein it could act as you have described. There are also unforeseen possibilities, such as if the singularity becomes so introspective that it forgets about the outer world. Those problems that happen with human thought could in theory also happen with a machine. Perhaps the human condition would turn into the singularity condition -- where it begins contemplating whether it has a worthwhile purpose. It may even kill itself if it feels its existence is unnecessary or harmful.