3 ms·

I don't think it's pure magic and feelings. From what I gather the conclusions people like Yudkowsky draw are rather from our own history and simple natural ord

by lewhoo 3y ago

I don't think it's pure magic and feelings. From what I gather the conclusions people like Yudkowsky draw are rather from our own history and simple natural order of the food chain. > I'm always thinking, who in power would ever allow that power be given to anybody, or in this case, anything, else? Those in power may share your skepticism towards agi and give up power involuntarily. I'm not saying I stand with Yudkowsky, because the weakness of his argument (or so I think) is the lack of falsification. Basically whatever you can think of he comes at you with "agi predicted that and counteracted." I do believe it is a serious topic and I'd hoped people didn't divide into two groups so quickly.

eurekin 3y ago
> simple natural order of the food chain So, AGI would need to exist in some robotic form (or control whatever keeps us alive), without oversight, control and share our biological needs and aspiritions (in order to participate in the food chain). This is one of example arguments so far removed from current reality, I'm shocked real engineers are participating in. This reminds me of the 2001 Space Odyssey scenario and wouldn't be surprised that's where the collective fear stems from (entertainment industry). In the same movie, aliens lit up one of the planets and made a sun out of it. How did they do that? No one knows, they are so much more advanced than us.
- lewhoo 3y ago
  > So, AGI would need to exist in some robotic form (or control whatever keeps us alive), without oversight, control and share our biological needs and aspiritions (in order to participate in the food chain). No I don't think so. To be at the top of the food chain doesn't necessarily mean to compete over the same resources. I think it's more like having all resources available and we are certainly interested in putting AI in charge of many of our resources, provided a capable AI arrives.
  - eurekin 3y ago
    > like having all resources ... > AI in charge of many of our resources > provided a capable AI arrives Yes, this is actually coming closer to reality. Please be more specific and list one resource, how we arrive at AI that controls it and why we do it, if it's so capable - without oversight
    - lewhoo 3y ago
      Anywhere where automation is cheaper is basically an answer for you. If it can be automated it will be. That includes various kinds of warfare, surveillance, energy resource management, healthcare etc. What you are basically asking is where on Earth would we be interested in putting a supervisor performing better than humans for a fraction of the cost.

by lewhoo 3y ago

eurekin 3y ago

> simple natural order of the food chain So, AGI would need to exist in some robotic form (or control whatever keeps us alive), without oversight, control and share our biological needs and aspiritions (in order to participate in the food chain). This is one of example arguments so far removed from current reality, I'm shocked real engineers are participating in. This reminds me of the 2001 Space Odyssey scenario and wouldn't be surprised that's where the collective fear stems from (entertainment industry). In the same movie, aliens lit up one of the planets and made a sun out of it. How did they do that? No one knows, they are so much more advanced than us.

lewhoo 3y ago
> So, AGI would need to exist in some robotic form (or control whatever keeps us alive), without oversight, control and share our biological needs and aspiritions (in order to participate in the food chain). No I don't think so. To be at the top of the food chain doesn't necessarily mean to compete over the same resources. I think it's more like having all resources available and we are certainly interested in putting AI in charge of many of our resources, provided a capable AI arrives.
- eurekin 3y ago
  > like having all resources ... > AI in charge of many of our resources > provided a capable AI arrives Yes, this is actually coming closer to reality. Please be more specific and list one resource, how we arrive at AI that controls it and why we do it, if it's so capable - without oversight
  - lewhoo 3y ago
    Anywhere where automation is cheaper is basically an answer for you. If it can be automated it will be. That includes various kinds of warfare, surveillance, energy resource management, healthcare etc. What you are basically asking is where on Earth would we be interested in putting a supervisor performing better than humans for a fraction of the cost.