4 ms·

What was that quote... "Provably unfriendly natural intelligence wants to build unprovably friendly artificial intelligence"

amitport 4y ago
I asked Bing's ChatGPT regarding your quote: "I’m sorry but I couldn’t find any relevant information about the quote you mentioned. It seems like it’s not a well-known quote. Could you please provide more context or details about it?"
VeninVidiaVicii 4y ago
The quote you’re thinking of is from computer scientist and researcher Stuart Russell: "The point of [AI alignment] is to ensure that the machines we create will be aligned with human values. And the reason we have to worry about it is that if we create machines that are more intelligent than we are, it's quite possible that those machines will have goals that are not aligned with our goals. In fact, they may not have any goals at all that we can understand or influence. This is the so-called 'provably unfriendly' scenario, where the machine has no motivation to do what we want, but is able to prevent us from interfering with its goals. The problem is that if we build machines that are provably unfriendly, then we will never be able to build machines that are 'provably friendly', because the unfriendly machines will always be able to prevent us from proving that they are friendly."
qgin 4y ago
That’s true, when have humans as a whole ever been consistently aligned with the interests of humans?
- sorokod 4y ago
  when mutually assured destruction became a thing.
  - nullsense 4y ago
    It's kind of a low bar that the only thing we can all agree on is that we don't kill absolutely everyone. A lot of people is fine, but not everyone.
13years 4y ago
"Demonstrably unfriendly natural intelligence seeks to create provably friendly artificial intelligence."
- nullsense 4y ago
  That's the one. Are classifieds still a thing? It reads like one of those.

4 ms·

What was that quote... "Provably unfriendly natural intelligence wants to build unprovably friendly artificial intelligence"

by nullsense 4y ago

amitport 4y ago
I asked Bing's ChatGPT regarding your quote: "I’m sorry but I couldn’t find any relevant information about the quote you mentioned. It seems like it’s not a well-known quote. Could you please provide more context or details about it?"
VeninVidiaVicii 4y ago
The quote you’re thinking of is from computer scientist and researcher Stuart Russell: "The point of [AI alignment] is to ensure that the machines we create will be aligned with human values. And the reason we have to worry about it is that if we create machines that are more intelligent than we are, it's quite possible that those machines will have goals that are not aligned with our goals. In fact, they may not have any goals at all that we can understand or influence. This is the so-called 'provably unfriendly' scenario, where the machine has no motivation to do what we want, but is able to prevent us from interfering with its goals. The problem is that if we build machines that are provably unfriendly, then we will never be able to build machines that are 'provably friendly', because the unfriendly machines will always be able to prevent us from proving that they are friendly."
qgin 4y ago
That’s true, when have humans as a whole ever been consistently aligned with the interests of humans?
- sorokod 4y ago
  when mutually assured destruction became a thing.
  - nullsense 4y ago
    It's kind of a low bar that the only thing we can all agree on is that we don't kill absolutely everyone. A lot of people is fine, but not everyone.
13years 4y ago
"Demonstrably unfriendly natural intelligence seeks to create provably friendly artificial intelligence."
- nullsense 4y ago
  That's the one. Are classifieds still a thing? It reads like one of those.