4 ms·
The article has some neat points but I feel like it's confusingly tugging in opposite directions. It's weird to assert that AIs couldn't possibly be accidentall
by AgentME 7y ago
The article has some neat points but I feel like it's confusingly tugging in opposite directions. It's weird to assert that AIs couldn't possibly be accidentally made to be singularly-focused on a task that's harmful in excess, but groups of people as corporations totally could. But also AIs and corporations are the same. But also only sociopaths would worry that AIs might possibly be accidentally made without human concerns, that's science fiction, only groups of people could manage to operate without human concerns.
I think the point of thinking about how we regulate corporations so they don't focus on singular goals in a harmful way is important. I just find the article's framing weird, as if it thinks people can only care about only one of AI alignment or corporation alignment, and that it's desperately important that they pick #2 instead of #1. I think the topics are actually very related and it's actually useful to think of them as different examples of the same problem. Thinking about AI alignment can help us understand how corporations should be regulated, and vice-versa.
(I think AI safety/friendliness/alignment problem is important, but it's really only relevant to human-level AGI. It's not about modern-level AI / machine learning / algorithms / whatever. No modern AI/ML understands the world at a human level and generates its own goals and motivation in a general sense. There's plenty of ethical issues about how we use modern AI/ML in businesses and so on but it's pretty separate from the AI alignment problem. The AI alignment problem is only an imminent issue further down the line, like "how do we build moonbases that don't fail?", which is interesting, and I'm tired of tons of articles bringing up the alignment problem like "There's some weirdos wondering about how to make buildings in space, but don't they know there's nothing to build things out of in low-earth orbit?? Are they just delusional?".)