4 ms·
Surely, if it is AGI it won't do stuff just because it is * told * to same way you as a company don't do exactly what your customer *tells* you to do but what y
by netdevnet 2y ago
Surely, if it is AGI it won't do stuff just because it is * told * to same way you as a company don't do exactly what your customer *tells* you to do but what you *think* it *wants or needs*.
So I expect AGI to do stuff we might not understand but further in the future we will look back with enough hindsight and we will understand why it did what it did and we will agree that it was the best action to take at that time. Just like children lacking understanding of why their parents tell them to eat bland veggies or do stuff they don't want to do even though it is good for them in the long-term. I expect this to be the main source of conflicts with AGI in the future.
- ben_w 2y agoThat sounds like the principal–agent problem and Coherent Extrapolated Volition? • https://en.wikipedia.org/wiki/Principal–agent_problem https://en.wikipedia.org/wiki/Principal–agent_problem • https://en.wikipedia.org/wiki/Friendly_artificial_intelligence#Coherent_extrapolated_volition https://en.wikipedia.org/wiki/Friendly_artificial_intelligen...