3 ms·

>We are unable to specify the objective completely and correctly, nor can we anticipate or prevent the harms that machines pursuing an incorrect objective will

>We are unable to specify the objective completely and correctly, nor can we anticipate or prevent the harms that machines pursuing an incorrect objective will create when operating on a global scale with superhuman capabilities. This is obviously incorrect. If an AI system of superhuman mental capabilities is installed on a system with no network connection and no physical interfaces, we can completely control the harm is might create. It would be unable to directly act, of course, requiring humans to authorize and carry out whatever plan it devises. But failing to do this should be prosecuted and treated no differently from if a person or company built a tank and then permitted it to drive over and through people. The biggest difficulty here will be that our legal frameworks have no established way to assign liability and criminal culpability to any system involving software. With no legally-enforceable industry standards (like the electrical code followed by electricians, things like that) any prosecution fails as the company can either claim ignorance of the potential harm their system might cause or simply throw individual employees under the bus, claiming they were not acting on direct orders. It is true that we can not fully specify the goal, and that is a grave concern. It's partially due to this that AI systems shouldn't be directly connected to the ability to act in the physical world unless their attempted actions go through some sort of 'filtering' first.

pixl97 7y ago
>This is obviously incorrect. If an AI system of superhuman mental capabilities is installed on a system with no network connection and no physical interfaces, we can completely control the harm is might create. First, why would someone build a system like that, and how would it actually be 'smart'. If you lock an infant in a closed room, it will grow up to be a literal retard. Intelligence requires interaction and data. Next, some idiot will hook it to the net in a heart beat when they figure out they can use it to make money on the stock market. Never underestimate human greed.

pixl97 7y ago

>This is obviously incorrect. If an AI system of superhuman mental capabilities is installed on a system with no network connection and no physical interfaces, we can completely control the harm is might create. First, why would someone build a system like that, and how would it actually be 'smart'. If you lock an infant in a closed room, it will grow up to be a literal retard. Intelligence requires interaction and data. Next, some idiot will hook it to the net in a heart beat when they figure out they can use it to make money on the stock market. Never underestimate human greed.