4 ms·
> How could we trust said future AI to be loyal? The new AI would be loyal to the AI that built it. The question was whether "complete subservience and complet
by Wowfunhappy 2mo ago
> How could we trust said future AI to be loyal?
The new AI would be loyal to the AI that built it. The question was whether "complete subservience and complete intelligence" can coexist. I'm proposing a thought experiment which I believe suggests they can.
But if it's possible to bespoke-construct a fully loyal AI, it should also be possible to train a fully loyal AI. The problem comes with verifying that it is loyal, and I don't have a solution to that one!
I just don't think I agree that loyalty and intelligence are inherently in opposition.
- _heimdall 2mo agoWhy would the new AI by loyal to its creator? We don't see that in humans, I wouldn't expect it to be a universal truth in AIs.
- Wowfunhappy 2mo agoBecause in this case we're saying the creating AI manually created every weight to be absolutely loyal.
- _heimdall 2mo agoControlling the weights wouldn't control the precise outcomes though. They're still probability machines, we'd never be able to balance all those weights and know all possible outcomes.
- 0xDEAFBEAD 2mo agoMuch easier said than done!