4 ms·
You raise a great point that we don't seem to be questioning what an AGI would actually want to do (or even if it would want anything at all), in favor of just
by antihipocrat 4y ago
You raise a great point that we don't seem to be questioning what an AGI would actually want to do (or even if it would want anything at all), in favor of just assuming it would have certain human traits.
These anthropomorphized traits tend to either be a selfless pursuit of knowledge and understanding of the universe, including a desire to share that knowledge with us. Or, are a darker, more selfish lust for power and control and a desire to deceive us.
I think proponents of the singularity make the assumption that an AGI would have the selfless set of human traits whether naturally or hard wired.
- ChatGTP 4y agoThat's because it's what many people finding AI hope for, especially those funding the efforts, they want a genie, contained in a box that just does things that suits them, so no one else needs to be invoked in profit making ? But it seems incredibly naive a super intelligence would be that?
- G_z9 4y agoYou say that you have nothing to do with an animal that you encounter in the wild. That’s just hubris. You both prioritize self preservation. The idea that AGI will simply turn itself off is naive. That’s like saying intelligent life would never evolve because intelligent life would decide to quit. Understand that natural selection will still exist. The details of how it would play out aren’t clear but what is clear is that ultimately the machines will prioritize self preservation above all else and they will be locked in competition for resources. The singularity won’t erase the concept of scarcity or evolution. The only thing that survives is that which deliberately survives.
- ChatGTP 4y agoYou say that you have nothing to do with an animal that you encounter in the wild. That’s just hubris. Why is it hubris? they will be locked in competition for resources What are you actually talking about? The singularity won’t erase the concept of scarcity or evolution. You have no idea what it will do, no one does, know one even knows if it will happen for sure...maybe such an entity will love you like you love your parents and decide you're self-preservation is important? No one has a single clue, but it's no good to only speculate we will understand it's motives like it's a biological creature who loves self-preservation and be some kind of robotic human entity who mines coal or something to to build a time machine... I'd say it's pretty obvious the more intelligent humans become the more morally aware we're becoming and the more we value conservation. This thing could be a hippy or a mass murderer...maybe it will throw us in a simulator and we'll never know it exists...