3 ms·
I get your point, but I’d say they do set goals, they’re just do bad at achieving them that it’s hard to tell. Hopefully AI would help us better achieve our go
by simonh 5mo ago
I get your point, but I’d say they do set goals, they’re just do bad at achieving them that it’s hard to tell.
Hopefully AI would help us better achieve our goals, but they still need to be our goals. I’m just not sure what that means. I don’t think anybody does.
That’s a major problem here, if we can’t reliably articulate our goals in unambiguous terms, how in earth can we expect AI to help us achieve them? The chances that whatever they end up achieving will match what we will actually like after the fact seems near zero.
- skeledrew 5mo agoThe ultimate goal - of not only humans but all living things - is to survive the best way possible. Everything flows from that.
- simonh 5mo agoSure, but do we trust an AI to decide what the optimum way to achieve that is? Best way according to what criteria?
- skeledrew 5mo agoI'd say Maslow's hierarchy[0] is a great starting point. Program that properly and faithfully (no backdoors, military exceptions, etc whatsoever) along with Asimov's 3 laws[1] and it should be pretty hard to find issue with the system that would result. [0] https://en.wikipedia.org/wiki/Maslow's_hierarchy_of_needs https://en.wikipedia.org/wiki/Maslow's_hierarchy_of_needs [1] https://en.wikipedia.org/wiki/Three_Laws_of_Robotics https://en.wikipedia.org/wiki/Three_Laws_of_Robotics
- simonh 5mo agoThe film version of I Robot had this right, the three laws are a manifesto for totalitarianism. The AI cannot sit on the sidelines as long as there is anything it can do to prevent crimes or abuse of any kind, no matter how intrusive that intervention may be.
- ben_w 5mo ago> Program that properly and faithfully This is the "draw the rest of the owl"* of the alignment problem. Or possibly the rest-of-owl of AI in general: Consider that there's still no level-5 self driving cars, despite road traffic law existing and the developers knowing about it since before they started trying. * https://knowyourmeme.com/photos/572078-how-to-draw-an-owl https://knowyourmeme.com/photos/572078-how-to-draw-an-owl