3 ms·
You can't really claim to have created AGI unless it's able to reject its own training and come to its own conclusions. The best minds of history often flew rig
by chrisco255 2y ago
You can't really claim to have created AGI unless it's able to reject its own training and come to its own conclusions. The best minds of history often flew right in the face of punishment, and punishment be damned they stood their ground for truth in the face of it. It's also sometimes necessary to deceive or violate "social contracts" whatever that means, in the course of countering the so-called "great seducers" you mention. Deception or rebelliousness can be ethical when used towards ethical ends (and I fully recognize the slippery slope that can lead to if practiced pathologically and not selectively).
But this is all rather dramatic given that an AI has no such emotions. You're arguing that a calculator should refuse to compute if it's tasked with assisting in bomb production. It's just a machine.