4 ms·
It is something that we need to outlaw. All it takes for that to be dangerous is for someone or some groups in competition to give it an overly broad goal like
by ilaksh 3y ago
It is something that we need to outlaw. All it takes for that to be dangerous is for someone or some groups in competition to give it an overly broad goal like "take control". But also people are stupidly trying to find ways to emulate life in these systems (such as reproductive and self-preservation instincts). Combine that with hyperspeed or hyperIQ AI and you just have to hope to stay on its good side because you cannot possibly keep up with the speed and effectiveness of those systems.
- fragmede 3y agoI think if we have to rely on humans to not glue an AI to itself because it's merely against the law, that we will find ourselves on the losing side real quickly. if you told me there is this piece of code that will make me money on the stock market but it is illegal to run, I can't say that I wouldn't run it.
- ilaksh 3y agoTrue but we should at least try to actively discourage it and educate people about existential risk. These will be so far beyond the scope of stock market trading. My main thought on this stuff that I have been repeating is that the only real mitigation is to prohibit the manufacture of certain levels of AI hardware. Again, hard to enforce, but you have to try. And not having the hardware exist will be more effective than laws. If we make an effort then we might be able to hold off the post-human era for a few generations. By post-human I don't mean that (necessarily) normal humans have been killed off, just that they don't control the planet anymore.