3 ms·
> Currently, the problem is "how do we robustly align an AI with any set of values." That's a fair point, and you're absolutely right. > They need to solve th
by TeMPOraL 2y ago
> Currently, the problem is "how do we robustly align an AI with any set of values."
That's a fair point, and you're absolutely right.
> They need to solve that problem before they can solve the next one.
Agreed. That, and they need to do it before they build an AGI.
Unfortunately, from X-risk perspective, the two are almost the same problem. The space of alignments that lead to prosperous, happy humanity is a very, very tiny area in the larger space of possible value systems an AI could have. Whether we align AI to something outside this area (failing the "what values should we align an AGI to" problem), or the AI drifts outside of it over time (chancing the "what values" problem, but failing the "how do we robustly align" one), the end result is the same.
- MostlyStable 2y agoYes, I agree that both problems need to be solved. But I think it's still worth focusing on where we actually are. Lots of people believe that they have a set of safe values to align an AI to (Musk thinks "curiosity" will work, another commenter in this thread suggested "don't kill humans"), and so those people will think that the alignment problem is trivial: "Just align the AI to these simple, obviously correct principles". But the truth is that it doesn't even matter whether or not they are correct (my personal opinion is that they are not), because we don't know how to align an AI to whatever their preferred values are. It makes it more obvious to more people how hard the problem is.
- lazide 2y agoEh, while we wish someone would do it, I don’t see how any of these things being described are actually a must do for something to meet the criteria described. There literally are no humans that meet the criteria of consistently following a set of values in all circumstances, or near as I can tell being ‘safe’ in all circumstances either. A bunch that pretend to of course.