2 ms·
It doesn't assume that we can understand AI motivations. It just says there are a large number of possible motivations, many of which wouldn't place any value o
by DennisP 12y ago
It doesn't assume that we can understand AI motivations. It just says there are a large number of possible motivations, many of which wouldn't place any value on anything that matters to humans. Given a superintelligent AI that competes with humans for resources, in pursuit of an unknown value function, it's likely that things won't end well for us.
It's possible that we could design a safe value function and a way to get the AI to keep that value function, but it doesn't look easy. Either way, if it's superintelligent it won't much matter how we act. We won't be driving.