3 ms·
I wonder how policymakers will define rogue AI. Bengio gives this definition: > A potentially rogue AI is an autonomous AI system that could behave in ways tha
by kaycebasques 3y ago
I wonder how policymakers will define rogue AI. Bengio gives this definition:
> A potentially rogue AI is an autonomous AI system that could behave in ways that would be catastrophically harmful to a large fraction of humans, potentially endangering our societies and even our species or the biosphere.
Is it only rogue if it can "catastophically" harm a "large fraction" of humans? Does "large fraction" imply greater than 10%? 25%? 50%? Does this definition imply that catastrophically harming a small fraction of humans is acceptable? Or moderately harming a large fraction?
- alpemre 3y agoIf it is hurting one human, it is not "rogue AI" then. It is "mean AI"? Pff. Asimov wrote first law of robotics in 1942: "A robot may not injure a human being or, through inaction, allow a human being to come to harm.". Why not start from here?
- sebzim4500 3y agoHave you read a single one of his books? They are almost all about how stupid those laws of robitics are.
- ilaksh 3y agoThey did start from there, and they improved it quite a bit. https://github.com/daveshap/HeuristicImperatives https://github.com/daveshap/HeuristicImperatives But none of that stuff prevents someone from just not giving it those types of rules, or deliberately designing it to gain control over its environment.