4 ms·
We can't micro-manage it, and there will be tremendous dangers, but there are reasons for both hope and fear. Code, in and of itself is lazy. If I compile a C
by ericb 15y ago
We can't micro-manage it, and there will be tremendous dangers, but there are reasons for both hope and fear. Code, in and of itself is lazy. If I compile a C program with nothing in main(), it will do nothing. So the only goals an AI has initially are what we give it to start, and what it ads to aid in achieving those goals.
Blank slate computer programs, and AI start from an ultimate desireless state of zen. It doesn't want to take over, it has no cares, it doesn't want to eat, and it doesn't care if it continues to exist or not. It doesn't want anything until we, or the system we design to evolve it in, trains it to want something.
Scenarios where we evolve AI or transcribe human brains are both the most dangerous, and most likely to succeed I think.
But the problem with both methods is that we don't directly control the goals of a transcribed AI, and if we evolve one, we would likely end up with an AI that is interested in self preservation. That, to me, is where it might decide that our interests, and its interests, are not aligned, and where we might run into...problems.
- deleted 15y ago[deleted]
- asolove 15y agoAny system which needs to be told from outside what to desire does not yet qualify as intelligent.
- hackinthebochs 15y agoWe ourselves are "told" what to desire. Our genes gives us drives to eat, procreate, survive, etc. We could potentially program an intelligent being that had no self preservation instinct and had an utmost reverence for human life.
- jules 15y agoOnly if we program it perfectly and if its software doesn't get mutated by random errors. The laws of evolution govern all self-replicating things that don't self-replicate perfectly and makes them as efficient as possible at self-replication.
- erikpukinskis 15y agoAll of your desires were dictated to you by your cultural backing. But I still think you're intelligent.
- sp332 15y agoThis is easily disproven by each desire that I have which is socially forbidden. Scratching where it itches (in public), etc.
- adavies42 15y agoanyone who thinks he knows exactly what he's told all his programs to do hasn't programmed much.
- nikhilgk 15y agoExactly. An AI machine made by digesting all of human knowledge and then capable of advancing it will not do it unless it was built with the specific "motive" of advancing that knowledge. Without that "purpose" it will just sit in an idle state waiting for the next input and trigger the next deductions. Only an evolved AI or one integrated to wetware brains will be self-aware enough to pursue higher goals like understanding and controlling the universe.