3 ms·

> Like, how does AlphaZero optimize for “how to slow Climate Change”? Do you want AIs exterminating humans? Because that's how you get AIs exterminating humans

• V-2 9y ago
  So we need to get the question right and down to all the details - how much are we ready to sacrifice eg. (in this case) for environment sake, etc. I believe every developer has found themselves in a situation where they'd be describing their problem in a StackOverflow question, only to realize half way through what the answer is. Just because they forced themselves to phrase the problem clearly and looked at it from a fresh perspective. That's the "rubber duck" effect at work. Who knows if we won't bump into this phenomenon pretty often when it comes to high level AI :) Merely setting the whole thing up will often provide such quality research and a solid answer before actually submitting the problem to the AI