3 ms·
We have no idea of what 27 or 27 million times smarter means functionally. We could hope that “smarter” might mean “not interested in taking over the world, bu
by robwwilliams 4y ago
We have no idea of what 27 or 27 million times smarter means functionally.
We could hope that “smarter” might mean “not interested in taking over the world, but rather in help maximize accomplishment, satisfaction, health span, and with a feeling of filial love toward its parents—-humanity, planet Earth, our sun, the laws of physics and chemistry, and the beautiful mess we call biology and evolution.”
Gently achieving those goals would be real indicator of high intelligence.
- ChatGTP 4y agoGently achieving those goals would be real indicator of high intelligence. Very well said. "Gently" is a great to be approaching this.
- nmca 4y agoThis is not true of goal directed agents and all RLHF models are trained with, ahem, RL; see: "Optimal Policies Tend to Seek Power" from NeurIPS 2021. It's a very useful instrumental goal to be very powerful.