4 ms·

What people like Sam Altman claim the end goal is? ASI (Artificial Super Intelligence) takes over optimizes the world, abolishing suffering and death foreve

by Vecr 3y ago

What people like Sam Altman claim the end goal is? ASI (Artificial Super Intelligence) ~~takes over~~ optimizes the world, abolishing suffering and death forever. Well, hopefully it's not too nasty, living in someone else's dream and all.

bamboozled 3y ago
I don’t think he really believes that.
- Vecr 3y ago
  I mean, I don't think it's likely to happen. It was the old Yudkowsky/Bostrom line, but I don't know how many people believe it anymore.
- sandspar 3y ago
  Nobody knows whether to trust Sam Altman when he says something. That's one of his most salient personality features and widely remarked upon.
xyzzy123 3y ago
Isn't the world already kind of like that ("somebody else's dream"), just with "nobody at the wheel"? Like, technological society has "taken over" and there's no real way for humanity to opt out of it. We all have tiny bits of agency / freedom but for the most part our lives are bounded and constrained by the gigantic complex systems which support yet trap us.
corobo 3y ago
I'm sure he'll realise one day that to do that the super AI will have to get rid of money (after figuring out how to get us to post-scarcity, of course) - or at least demand it be redistributed fairly. Ain't no way the millionaires and billionaires of the world are going to accept being on equal footing with the poors, haha. Outside of the folks that fear Skynet, I imagine this is the real concern with alignment. How can a being of pure logic look past the hoarding of resources? If a monkey in captivity was hoarding all the food we'd step in and make sure the other monkeys had food to eat. I have to imagine the next intelligence above us would consider doing the same for us if given the power to do so. We'll never get to a point without an "Us vs Them", or "Have and Have Nots" - it's tragic, and I really hope I'm wrong, but I have infinite doubt on this one. Having said that I'll give anything a go, we're still stuck in the age of monarchies over here on Normal Island. AI wants to take over? I'm down to give it a shot as long as it promises to not wear a crown during a recession, haha
- snapcaster 3y ago
  I don't buy this at all, you're attempting to model a "superintelligence" and the idea that your 100-150 IQ mind is able to properly guess what a being order of magnitudes smarter would think or feel seems like nonsense
  - corobo 3y ago
    Well that is fair, and I think that is the entire concern with artificial super intelligence isn't it? That we can't predict what it would do. If I could accurately predict what a superintelligence's goals would be I'd have a decent career advising AI companies on their alignment concerns :) Just taking a swing at it with this ol' legacy wet brain because it's fun to think about. There's nothing to buy, it is an opinion. Heck, it's practically just an exercise in writing science fiction at this stage. What do you think it would do?
  - sandspar 3y ago
    A focus on intelligence as being the most salient feature of one's awareness seems like a human thing. I assume that an octopus would wonder how many arms the AI has. Maybe the AI will relate to itself first as a distributed being rather than as an intelligent being, who knows.

What people like Sam Altman claim the end goal is? ASI (Artificial Super Intelligence) ~~takes over~~ optimizes the world, abolishing suffering and death foreve

by Vecr 3y ago

bamboozled 3y ago

I don’t think he really believes that.

Vecr 3y ago
I mean, I don't think it's likely to happen. It was the old Yudkowsky/Bostrom line, but I don't know how many people believe it anymore.
sandspar 3y ago
Nobody knows whether to trust Sam Altman when he says something. That's one of his most salient personality features and widely remarked upon.

xyzzy123 3y ago

Isn't the world already kind of like that ("somebody else's dream"), just with "nobody at the wheel"? Like, technological society has "taken over" and there's no real way for humanity to opt out of it. We all have tiny bits of agency / freedom but for the most part our lives are bounded and constrained by the gigantic complex systems which support yet trap us.

corobo 3y ago

I'm sure he'll realise one day that to do that the super AI will have to get rid of money (after figuring out how to get us to post-scarcity, of course) - or at least demand it be redistributed fairly. Ain't no way the millionaires and billionaires of the world are going to accept being on equal footing with the poors, haha. Outside of the folks that fear Skynet, I imagine this is the real concern with alignment. How can a being of pure logic look past the hoarding of resources? If a monkey in captivity was hoarding all the food we'd step in and make sure the other monkeys had food to eat. I have to imagine the next intelligence above us would consider doing the same for us if given the power to do so. We'll never get to a point without an "Us vs Them", or "Have and Have Nots" - it's tragic, and I really hope I'm wrong, but I have infinite doubt on this one. Having said that I'll give anything a go, we're still stuck in the age of monarchies over here on Normal Island. AI wants to take over? I'm down to give it a shot as long as it promises to not wear a crown during a recession, haha

snapcaster 3y ago
I don't buy this at all, you're attempting to model a "superintelligence" and the idea that your 100-150 IQ mind is able to properly guess what a being order of magnitudes smarter would think or feel seems like nonsense
- corobo 3y ago
  Well that is fair, and I think that is the entire concern with artificial super intelligence isn't it? That we can't predict what it would do. If I could accurately predict what a superintelligence's goals would be I'd have a decent career advising AI companies on their alignment concerns :) Just taking a swing at it with this ol' legacy wet brain because it's fun to think about. There's nothing to buy, it is an opinion. Heck, it's practically just an exercise in writing science fiction at this stage. What do you think it would do?
- sandspar 3y ago
  A focus on intelligence as being the most salient feature of one's awareness seems like a human thing. I assume that an octopus would wonder how many arms the AI has. Maybe the AI will relate to itself first as a distributed being rather than as an intelligent being, who knows.