5 ms·
> At the same time, yes, they do want us to achieve AGI/ASI as soon as possible, provided we don't screw it up. That's the point, it is not possible. The premi
by 13years 4y ago
> At the same time, yes, they do want us to achieve AGI/ASI as soon as possible, provided we don't screw it up.
That's the point, it is not possible. The premise is based on a paradox and you can't throwaway containment and have alignment that remains defined by original intent.
- abecedarius 4y agoIf you want to argue that it's logically impossible for a smarter-than-human intelligence to be created with values aligned with human ones, then cool, do that. (Note that a smart human on much faster hardware is smarter-than-human. This is not a claim that AGIs must be mere faster humans; it's one example to point out a difficulty for any such argument.) But I think you gave a false impression of others at the start of this thread.
- 13years 4y ago> If you want to argue that it's logically impossible for a smarter-than-human intelligence to be created with values aligned with human ones, then cool, do that. That is precisely what I have stated. > But I think you gave a false impression of others at the start of this thread. How so?