2 ms·
> I think alignment is poorly defined. That's the root of the problem. The idea is simple. We will create a god. In the process, we will become to it what ant
by TeMPOraL 4y ago
> I think alignment is poorly defined.
That's the root of the problem.
The idea is simple. We will create a god. In the process, we will become to it what ants, or bacteria, are to us. We will be powerless to stop it, so we need to make sure it never does anything to directly or indirectly hurt us. We want it to answer our prayers, and we want those prayers to not backfire and explode in our faces. We want it to never decide to bulldoze Earth one day because it has a temporary interest in paperclips and needs the raw ore to make some.
The details of how to achieve this outcome, and even the details of this outcome, are less and less clear the more you dig into them.