4 ms·
>If we were writing all the weights by hand Writing 10 trillion weights by hand is obviously impractical, so that leads us to... >if some future AI was doing
by 0xDEAFBEAD 2mo ago
>If we were writing all the weights by hand
Writing 10 trillion weights by hand is obviously impractical, so that leads us to...
>if some future AI was doing so
How could we trust said future AI to be loyal? You're just moving the problem around, not solving it.
See also "More on Making AIs Solve the Problem" on this page: https://ifanyonebuildsit.com/11/more-on-some-of-the-plans-we-critiqued-in-the-book#more-on-making-ais-solve-the-problem https://ifanyonebuildsit.com/11/more-on-some-of-the-plans-we...
- Wowfunhappy 2mo ago> How could we trust said future AI to be loyal? The new AI would be loyal to the AI that built it. The question was whether "complete subservience and complete intelligence" can coexist. I'm proposing a thought experiment which I believe suggests they can. But if it's possible to bespoke-construct a fully loyal AI, it should also be possible to train a fully loyal AI. The problem comes with verifying that it is loyal, and I don't have a solution to that one! I just don't think I agree that loyalty and intelligence are inherently in opposition.
- _heimdall 2mo agoWhy would the new AI by loyal to its creator? We don't see that in humans, I wouldn't expect it to be a universal truth in AIs.
- Wowfunhappy 2mo agoBecause in this case we're saying the creating AI manually created every weight to be absolutely loyal.
- _heimdall 2mo agoControlling the weights wouldn't control the precise outcomes though. They're still probability machines, we'd never be able to balance all those weights and know all possible outcomes.
- 0xDEAFBEAD 2mo agoMuch easier said than done!