3 ms·
> One thing I've wondered is when Effective Altruists are going to stop calling AI ethics neglected. AI ethics isn’t neglected because AI ethics doesn’t matter
by barry-cotter 4y ago
> One thing I've wondered is when Effective Altruists are going to stop calling AI ethics neglected.
AI ethics isn’t neglected because AI ethics doesn’t matter. AI alignment matters. If a self-bootstrapping generally intelligent AI emerges the only important thing about it is “Is this aligned with human values?”. If the answer is no we’re all going to die because we’re made of atoms at the bottom of a gravity well and it’s going to use all the atoms there before getting out. The ethics of AI is completely irrelevant in comparison.
- btrettel 4y agoI tend to use the terms "AI ethics", "AI safety", and "AI alignment" interchangeably. This may not be technically correct.
- Max_Limelihood 4y agoIt’s not; they’re pretty much completely unrelated fields. AI ethics focuses very little on AI alignment issues, which tends to worry about much bigger and more general problems. The fact that you’re grouping AI alignment with is kind of an indication of the problem; most people have heard so little about AI alignment problems that they assume it’s the same thing as AI ethics.
- btrettel 4y ago> they’re pretty much completely unrelated fields Completely unrelated? Even you must accept that they are related through AI. But, I now see that AI ethics and AI alignment are different. Thank you. However, I think my larger point still stands as I was thinking mostly about efforts under the banners of "AI safety" and "AI alignment" when I wrote my comments here. I do not believe these efforts are "neglected" in the sense 80,000 Hours uses.
- dotsam 4y agoA miniscule fraction of global GDP going into preventing misaligned AI would always seem like neglect if you thought the end of the world was at stake.