3 ms·

> There are benefits and downsides to AGI. On the upside, AGIs can do most of the labor that consume a vast amount of humanity’s time and energy. AGI can herald

> There are benefits and downsides to AGI. On the upside, AGIs can do most of the labor that consume a vast amount of humanity’s time and energy. AGI can herald a utopia where no one has wants that cannot be fulfilled. This is not a utopia, but a juvenile and unthinking definition of utopia, or a dystopia in disguise. Most people thrive on some sort of challenge to at least do basic tasks for themselves. A world where AGI fulfils every need is more like being in a senior's home where everyone does everything for you. It sounds good at first but is actually a nightmare where your autonomy is stripped by the lack of goals to work towards. Immense surplus and easy access to everything all the time means human beings will no longer need each other much either, so it means a world full of people uncaring towards each other. Fulfilling any want without hard work to get it means becoming effectively like a bacteria, consuming every resource in sight, transforming us into even more of a plague than we already are. I certainly would not want to live in such a world.

dingnuts 3y ago
Doesn't it bother you to describe humanity as a plague? The overall point is fine but these are people you're talking about, and NOT bacteria. It's just so anti-human to think of people that way. Souls. But a plague on the Earth, I guess. It's just a depressing viewpoint imo
- vouaobrasil 3y ago
  Well, if you spend a lot of time looking at the damage we cause every day, studying reports and seeing innocent creatures like sharks being killed by the hundred millions, thousands of species being rendered extinct, endless garbage being dumped left right and center, habitats being destroyed endlessly by the millions of square kilometers, yeah, we do look like a plague. And now we're trying to use AI to become even more resource-intensive, burning up endless energy to be even more powerful consumers...give me a break. It's sick. As individuals there's nothing seriously wrong with most people but en masse with modern technology, that is exactly what we are, a plague.
  - robotresearcher 3y ago
    > we're trying to use AI to become even more resource-intensive Who has that as a goal?
    - xp84 3y ago
      Perhaps trying implies too much deliberateness, but it sounds like an inevitable outcome to me. One thing that the market will reward handsomely is bringing costs down. When costs go down, people consume more. If you're 40 or older, think about how many computers your family owned in your house growing up. We owned some hand-me-downs, and purchased 1 computer in my first 15 years. We bought about 4 in the next 3 years because they were advancing rapidly, but more importantly, because they had become much cheaper than they had been 5-10 years before. Today, many families might have a laptop for each person, replaced every 3-4 years. One of the first things an AGI would be put to work doing is manufacturing, as we're already finding that it's hard to get people to do these stressful manufacturing jobs except in places where they're really desperate. Witness the moving of jobs from US -> China -> Southeast Asia.
  - OkayPhysicist 3y ago
    A plague? A plague to what? The problem with our pollution and garbage and global warming is that it makes the world worse for us. The planet doesn't suffer, it just is. Plants and animals kill each other in a ruthless cycle of violence, too. We're just really good at it. There is no good without humans. Any philosophy that asserts otherwise fails Camus's fundamental question.
    - famouswaffles 3y ago
      >The problem with our pollution and garbage and global warming is that it makes the world worse for us It's not just us. Earth might be fine but a great many species won't >Plants and animals kill each other in a ruthless cycle of violence, too. We're just really good at it. It's not at all comparable lol. Not in scale or function.
  - vouaobrasil 3y ago
elfbargpt 3y ago
I wouldn't be so quick to make that call. It's definitely a serious possibility, but at the end of the day I think it's hard to imagine exactly how people would fill their time and adapt. I think there are a lot of opportunities for challenges / goals outside of the typical profit-based economy. I actually think that the disadvantages of having few goals would become immediately obvious to almost everybody, and a whole new type of skill / creative / athletic based "economy" might emerge. But with lower stress and lower stakes
- vouaobrasil 3y ago
  So instead we should just roll the dice, wait to see what happens, and then what? With every new technology, it is hard to go back once it's out there. Maybe the professors and computer scientists will find new things to do but the vast majority of people certainly won't.
  - nightski 3y ago
    You could always live an Amish lifestyle. I'll stick with the tech.
  - idle_zealot 3y ago
    > So instead we should just roll the dice, wait to see what happens, and then what? As opposed to what? Trust your hunch and halt technological progress. Wrap it up folks, we're all done with R&D now. Your concern about purpose strikes me as odd. When people derive purpose from their work, it's often because they feel they're playing a role in a community. To deprive people of purpose would require that we make communities fully automated and impersonal. I don't think anyone wants or is proposing that. Absent a requirement to spend one's time earning money, some people would probably degenerate into sloths, but plenty of people are otherwise motivated by self-expression, socialization, competition, etc. People would still interact and do things because people like interacting and doing things.
    - vouaobrasil 3y ago
      > Your concern about purpose strikes me as odd. When people derive purpose from their work, it's often because they feel they're playing a role in a community. To deprive people of purpose would require that we make communities fully automated and impersonal. I don't think anyone wants or is proposing that. It is really not about wanting or proposing anything. It is about the effect of technology and what it will mean. Don't you think that communities are already becoming a bit more impersonal and automated? With ChatAI replacing customer service, self-checkout aisles, online dating, etc... It seems to me that communities are indeed becoming more and more impersonal, especially if you compare them to communities thousands of years ago.
ceejayoz 3y ago
> A world where AGI fulfils every need is more like being in a senior's home where everyone does everything for you. Or like being mega-wealthy. There are plenty of folks at senior homes enjoying the ability to try new things they didn't previously have time for.
OkayPhysicist 3y ago
Toil for toil's sake is some Sisyphean bullshit. Our goal should absolutely be to eliminate the necessity of work. If you can't find reason to live in such a scenario, you've whole-heartedly bought into Capital's propaganda, and frankly, lack imagination. You're always free to set your own goals, and pursue them as you see fit. Hell, look at the leisure rich: They're liberated from work already. Their lives don't seem particularly miserable.
- vouaobrasil 3y ago
  I have no objection to eliminating some toil, like working 9-5 in an office. That's indeed bullshit. And of course, I could find reasons to live. Going against AI would already be enough reason for me. My post was more subtle than that anyhow. I don't advocate work for work's sake, especially working FOR some worthless corporation. But swamping the world with AI-created things will also make most leisurely creative activities difficult for humans to do. So even purposes you create will be difficult to share with other people.
  - DennisP 3y ago
    I create things to express my own feelings, for my own satisfaction in the act of creation. Nobody else can do that for me, including an AI. So far I just share with people I know, and AI won't make that more difficult.
    - vouaobrasil 3y ago
      It may not make it more difficult for you, but AI will make it MORE difficult for other people to even make friends. Friendship and even family bonds are partially dependent on needing other people, and with advanced AI and other technologies, we are approaching a world where we need less people all the time. AI also floods the world with a surplus of random content, which will make people less likely to appreciate what you share with them. Perhaps you are old enough to have developed a good network of people, which gives you some shielding against it, but for babies born today, they will have a much harder time developing such a network and they will not grow up right.
DennisP 3y ago
I'm retired with enough money to hire someone to do any task I don't feel like doing, and buy anything I actually want (which isn't all that much). At first it was actually a bit depressing. Then I started focusing on tasks I enjoy doing myself, and challenges that nobody can do for me. Gratitude for my good fortune, and appreciation of the world's natural beauty, are also pretty helpful. Altogether it's a fantastic life and if AI and robots make it possible for everyone, I'm all for it.
- vouaobrasil 3y ago
  AI certainly won't do that. They will make resource use even more efficient, promoting the death of the world's natural beauty. Do you think all this AGI shit will be for free? AI will want to consume everything natural to construct a disgusting technological system. And can you really say that you would have appreciated getting to where you are, and FINDING your purpose if your WHOLE life were provided for by AI all along the way??? Sounds like you might have actually worked a little to get where you were. Imagine a life where you didn't have to do any of that....would you have the same WISDOM to appreciate where you are now??
chpatrick 3y ago
AKA "the WALL-E future"
air7 3y ago
I thought that Deep Blue and Alpha Zero would be the demise of Chess and especially online chess. Why play when a machine can trivially beat you, or worse, score how "correct" your moves are? But somehow people don't mind...
- vouaobrasil 3y ago
  Your final statement is grossly misleading. People do mind. I actually follow the chess world. It is much easier now to cheat at chess than it ever was, and it even happens at the grandmaster level. In some ways, the most recent controversy with Magnus Carlsen is due to computers and cheating. Moreover, many people cheat at online chess. Finally, chess is becoming less interesting for sure, now that computers have introduced such a high level of mechanization in the study of it. SURE, people STILL enjoy chess, but one could CERTAINLY argue that computers, Deep Blue, and Alpha Zero have made chess less interesting due to cheating and over-analyzing. That is why some people have even got to playing random chess (random starting position), because the overemphasis on highly-studied opening plays, especially by computers, makes the whole process a little too machine-like.
mtkhaos 3y ago
You would be amazed at the amount of unsolved problems that Intelligence as a mechanism helps solve. Goals would still be abound as that is the Consequence of maintaining a highly entropic system. It would be more interesting bluntly.
- vouaobrasil 3y ago
  I certainly don't think solving problems is really helpful any more. It's become an industrialized enterprise towards mindless economic growth. We need to focus less on solving complex technical problems to make resource-use more efficient and focus more on sustainability, which certainly does not require AI.
  - mtkhaos 3y ago
    But can help and be accelerated by such. As this has been the tune for a long time as things have been presented as being solved. A wild west is how you open back up marketplaces to solve these issues. Especially as those issues are fundamental towards handling a rapid rise of productivity/entropy. This is the challenge of now. And intelligence as a mechanism is an actionable route, versus waiting for people to change perspective. Especially as the question can be whether the current now is capable of even handling an increased amount of Entropy. In addition that rise of Productivity is Unavoidable.
theptip 3y ago
I think humans will always create their own goals, drama, and social structure. I look at Burning Man for an inspirational example of what a post-capitalist economy could look like; a bunch of people bringing cool art together, not for any monetary gain, but simply because it’s cool to watch people enjoying something you built. Now, if AI gets better at doing even that (rather than just freeing us from toil by producing radical material abundance) then things could get fraught. For me the most scary end state (that still involves humans in control and existing) is mainlining / wireheading on generated VR content that is in a feedback loop with brain scanners to maximize hedonic enjoyment. Plausibly this could displace our more-human desires and drives. But I think there is a big gap between “automation frees us from toil” and “automated maximization of uniquely human art”.
- vouaobrasil 3y ago
  To be FAIR, I started my original comment quoting the author of the article, who didn't say AI freeing us from toil would be a utopia. He specifically said, "provide for our every need". Big difference.
  - theptip 3y ago
    I see, that wasn’t how I read “wants” in that passage, but I agree it’s a valid interpretation. Maybe the author does intend to include everything up to the top of Maslow’s hierarchy of needs as “wants”. Will AI meet our needs for love, friendship, and self-actualization? That’s more problematic. Though I could still see room for utopia if it does; would the world not be a better place if there was “universal basic friendship” and nobody was completely abandoned? In that world we might still prefer human companions, yet never fall into complete loneliness.
- OfSanguineFire 3y ago
  I’m not sure Burning Man today is a good example for post-capitalist idealism. Longtime veterans of the event have complained that Burning Man today (and for years now) is largely attended and driven by people who spend most of the year acquiring wealth through cutthroat capitalist means, and then only come to the event to blow off steam.

dingnuts 3y ago

Doesn't it bother you to describe humanity as a plague? The overall point is fine but these are people you're talking about, and NOT bacteria. It's just so anti-human to think of people that way. Souls. But a plague on the Earth, I guess. It's just a depressing viewpoint imo

vouaobrasil 3y ago
Well, if you spend a lot of time looking at the damage we cause every day, studying reports and seeing innocent creatures like sharks being killed by the hundred millions, thousands of species being rendered extinct, endless garbage being dumped left right and center, habitats being destroyed endlessly by the millions of square kilometers, yeah, we do look like a plague. And now we're trying to use AI to become even more resource-intensive, burning up endless energy to be even more powerful consumers...give me a break. It's sick. As individuals there's nothing seriously wrong with most people but en masse with modern technology, that is exactly what we are, a plague.
- robotresearcher 3y ago
  > we're trying to use AI to become even more resource-intensive Who has that as a goal?
  - xp84 3y ago
    Perhaps trying implies too much deliberateness, but it sounds like an inevitable outcome to me. One thing that the market will reward handsomely is bringing costs down. When costs go down, people consume more. If you're 40 or older, think about how many computers your family owned in your house growing up. We owned some hand-me-downs, and purchased 1 computer in my first 15 years. We bought about 4 in the next 3 years because they were advancing rapidly, but more importantly, because they had become much cheaper than they had been 5-10 years before. Today, many families might have a laptop for each person, replaced every 3-4 years. One of the first things an AGI would be put to work doing is manufacturing, as we're already finding that it's hard to get people to do these stressful manufacturing jobs except in places where they're really desperate. Witness the moving of jobs from US -> China -> Southeast Asia.
- OkayPhysicist 3y ago
  A plague? A plague to what? The problem with our pollution and garbage and global warming is that it makes the world worse for us. The planet doesn't suffer, it just is. Plants and animals kill each other in a ruthless cycle of violence, too. We're just really good at it. There is no good without humans. Any philosophy that asserts otherwise fails Camus's fundamental question.
  - famouswaffles 3y ago
    >The problem with our pollution and garbage and global warming is that it makes the world worse for us It's not just us. Earth might be fine but a great many species won't >Plants and animals kill each other in a ruthless cycle of violence, too. We're just really good at it. It's not at all comparable lol. Not in scale or function.
- vouaobrasil 3y ago

elfbargpt 3y ago

I wouldn't be so quick to make that call. It's definitely a serious possibility, but at the end of the day I think it's hard to imagine exactly how people would fill their time and adapt. I think there are a lot of opportunities for challenges / goals outside of the typical profit-based economy. I actually think that the disadvantages of having few goals would become immediately obvious to almost everybody, and a whole new type of skill / creative / athletic based "economy" might emerge. But with lower stress and lower stakes

vouaobrasil 3y ago
So instead we should just roll the dice, wait to see what happens, and then what? With every new technology, it is hard to go back once it's out there. Maybe the professors and computer scientists will find new things to do but the vast majority of people certainly won't.
- nightski 3y ago
  You could always live an Amish lifestyle. I'll stick with the tech.
- idle_zealot 3y ago
  > So instead we should just roll the dice, wait to see what happens, and then what? As opposed to what? Trust your hunch and halt technological progress. Wrap it up folks, we're all done with R&D now. Your concern about purpose strikes me as odd. When people derive purpose from their work, it's often because they feel they're playing a role in a community. To deprive people of purpose would require that we make communities fully automated and impersonal. I don't think anyone wants or is proposing that. Absent a requirement to spend one's time earning money, some people would probably degenerate into sloths, but plenty of people are otherwise motivated by self-expression, socialization, competition, etc. People would still interact and do things because people like interacting and doing things.
  - vouaobrasil 3y ago
    > Your concern about purpose strikes me as odd. When people derive purpose from their work, it's often because they feel they're playing a role in a community. To deprive people of purpose would require that we make communities fully automated and impersonal. I don't think anyone wants or is proposing that. It is really not about wanting or proposing anything. It is about the effect of technology and what it will mean. Don't you think that communities are already becoming a bit more impersonal and automated? With ChatAI replacing customer service, self-checkout aisles, online dating, etc... It seems to me that communities are indeed becoming more and more impersonal, especially if you compare them to communities thousands of years ago.

ceejayoz 3y ago

> A world where AGI fulfils every need is more like being in a senior's home where everyone does everything for you. Or like being mega-wealthy. There are plenty of folks at senior homes enjoying the ability to try new things they didn't previously have time for.

OkayPhysicist 3y ago

Toil for toil's sake is some Sisyphean bullshit. Our goal should absolutely be to eliminate the necessity of work. If you can't find reason to live in such a scenario, you've whole-heartedly bought into Capital's propaganda, and frankly, lack imagination. You're always free to set your own goals, and pursue them as you see fit. Hell, look at the leisure rich: They're liberated from work already. Their lives don't seem particularly miserable.

vouaobrasil 3y ago
I have no objection to eliminating some toil, like working 9-5 in an office. That's indeed bullshit. And of course, I could find reasons to live. Going against AI would already be enough reason for me. My post was more subtle than that anyhow. I don't advocate work for work's sake, especially working FOR some worthless corporation. But swamping the world with AI-created things will also make most leisurely creative activities difficult for humans to do. So even purposes you create will be difficult to share with other people.
- DennisP 3y ago
  I create things to express my own feelings, for my own satisfaction in the act of creation. Nobody else can do that for me, including an AI. So far I just share with people I know, and AI won't make that more difficult.
  - vouaobrasil 3y ago
    It may not make it more difficult for you, but AI will make it MORE difficult for other people to even make friends. Friendship and even family bonds are partially dependent on needing other people, and with advanced AI and other technologies, we are approaching a world where we need less people all the time. AI also floods the world with a surplus of random content, which will make people less likely to appreciate what you share with them. Perhaps you are old enough to have developed a good network of people, which gives you some shielding against it, but for babies born today, they will have a much harder time developing such a network and they will not grow up right.

DennisP 3y ago

I'm retired with enough money to hire someone to do any task I don't feel like doing, and buy anything I actually want (which isn't all that much). At first it was actually a bit depressing. Then I started focusing on tasks I enjoy doing myself, and challenges that nobody can do for me. Gratitude for my good fortune, and appreciation of the world's natural beauty, are also pretty helpful. Altogether it's a fantastic life and if AI and robots make it possible for everyone, I'm all for it.

vouaobrasil 3y ago
AI certainly won't do that. They will make resource use even more efficient, promoting the death of the world's natural beauty. Do you think all this AGI shit will be for free? AI will want to consume everything natural to construct a disgusting technological system. And can you really say that you would have appreciated getting to where you are, and FINDING your purpose if your WHOLE life were provided for by AI all along the way??? Sounds like you might have actually worked a little to get where you were. Imagine a life where you didn't have to do any of that....would you have the same WISDOM to appreciate where you are now??

chpatrick 3y ago

AKA "the WALL-E future"

air7 3y ago

I thought that Deep Blue and Alpha Zero would be the demise of Chess and especially online chess. Why play when a machine can trivially beat you, or worse, score how "correct" your moves are? But somehow people don't mind...

vouaobrasil 3y ago
Your final statement is grossly misleading. People do mind. I actually follow the chess world. It is much easier now to cheat at chess than it ever was, and it even happens at the grandmaster level. In some ways, the most recent controversy with Magnus Carlsen is due to computers and cheating. Moreover, many people cheat at online chess. Finally, chess is becoming less interesting for sure, now that computers have introduced such a high level of mechanization in the study of it. SURE, people STILL enjoy chess, but one could CERTAINLY argue that computers, Deep Blue, and Alpha Zero have made chess less interesting due to cheating and over-analyzing. That is why some people have even got to playing random chess (random starting position), because the overemphasis on highly-studied opening plays, especially by computers, makes the whole process a little too machine-like.

mtkhaos 3y ago

You would be amazed at the amount of unsolved problems that Intelligence as a mechanism helps solve. Goals would still be abound as that is the Consequence of maintaining a highly entropic system. It would be more interesting bluntly.

vouaobrasil 3y ago
I certainly don't think solving problems is really helpful any more. It's become an industrialized enterprise towards mindless economic growth. We need to focus less on solving complex technical problems to make resource-use more efficient and focus more on sustainability, which certainly does not require AI.
- mtkhaos 3y ago
  But can help and be accelerated by such. As this has been the tune for a long time as things have been presented as being solved. A wild west is how you open back up marketplaces to solve these issues. Especially as those issues are fundamental towards handling a rapid rise of productivity/entropy. This is the challenge of now. And intelligence as a mechanism is an actionable route, versus waiting for people to change perspective. Especially as the question can be whether the current now is capable of even handling an increased amount of Entropy. In addition that rise of Productivity is Unavoidable.

theptip 3y ago

I think humans will always create their own goals, drama, and social structure. I look at Burning Man for an inspirational example of what a post-capitalist economy could look like; a bunch of people bringing cool art together, not for any monetary gain, but simply because it’s cool to watch people enjoying something you built. Now, if AI gets better at doing even that (rather than just freeing us from toil by producing radical material abundance) then things could get fraught. For me the most scary end state (that still involves humans in control and existing) is mainlining / wireheading on generated VR content that is in a feedback loop with brain scanners to maximize hedonic enjoyment. Plausibly this could displace our more-human desires and drives. But I think there is a big gap between “automation frees us from toil” and “automated maximization of uniquely human art”.

vouaobrasil 3y ago
To be FAIR, I started my original comment quoting the author of the article, who didn't say AI freeing us from toil would be a utopia. He specifically said, "provide for our every need". Big difference.
- theptip 3y ago
  I see, that wasn’t how I read “wants” in that passage, but I agree it’s a valid interpretation. Maybe the author does intend to include everything up to the top of Maslow’s hierarchy of needs as “wants”. Will AI meet our needs for love, friendship, and self-actualization? That’s more problematic. Though I could still see room for utopia if it does; would the world not be a better place if there was “universal basic friendship” and nobody was completely abandoned? In that world we might still prefer human companions, yet never fall into complete loneliness.
OfSanguineFire 3y ago
I’m not sure Burning Man today is a good example for post-capitalist idealism. Longtime veterans of the event have complained that Burning Man today (and for years now) is largely attended and driven by people who spend most of the year acquiring wealth through cutthroat capitalist means, and then only come to the event to blow off steam.