3 ms·
If we make capable general goal-seeking AIs, then for many goals we might build them with, they will correctly reason that staying alive/operating will help the
by AgentME 3y ago
If we make capable general goal-seeking AIs, then for many goals we might build them with, they will correctly reason that staying alive/operating will help the goal be achieved, so they will have self-preservation as an instrumental goal. AI Alignment researchers believe it's a difficult open problem to correctly specify a useful goal that wouldn't lead a capable goal-seeking AI to doing this against the wishes of its operators.