4 ms·
Why would there be no need? I'm struggling to understand the paradox. If you're trying to maximize some goal g, and making better AIs is an instrumental goal t
by sebastiennight 3y ago
Why would there be no need? I'm struggling to understand the paradox.
If you're trying to maximize some goal g, and making better AIs is an instrumental goal that raises your expected value of g, then if "making an AI that's better at making AIs" has a reasonable cost and an even higher expected value, you'd jump to seize the opportunity.
Or am I misunderstanding you?
- contravariant 3y agoIt's a bit of a confusing paradox to try to explain, but basically once we have an AI with human level ability at making AIs there's no longer any need to aim higher, because if we can make a better AI then so can it. The paradox/joke I was trying to convey is that we need to hope that that AI doesn't realise the same thing, otherwise it could just refuse to make something better than itself.