4 ms·

the first step of safe superintelligence is to abolish capitalism

next_xibalba 2y ago
That’s the first step towards returning to candlelight. So it isn’t a step toward safe super intelligence, but it is a step away from any super intelligence. So I guess some people would consider that a win.
- yk 2y ago
  Not sure if you want to share the capitalist system with an entity that outcompetes you by definition. Chimps don't seem to do too well under capitalism.
  - next_xibalba 2y ago
    You might be right, but that wasn't my point. Capitalism might yield a friendly AGI or an unfriendly AGI or some mix of both. Collectivism will yield no AGI.
    - CRConrad 2y ago
      First good argument for collectivism I've seen in a long while.
ganyu 2y ago
One can already see the beginning of AI enslaving humanity through the establishment. Companies work on AI get more investment and those who don't gets kicked out of the game. Those who employ AI get more investment and those who pay humans lose confidence through the market. People lose jobs, get harshly low birth rates while AI thrives. Tragic.
- nemo44x 2y ago
  So far it is only people telling AI what to do. When we reach the day where it is common place for AI to tell people what to do then we are possibly in trouble.
speed_spread 2y ago
And then seize the means of production.
cscurmudgeon 2y ago
Why does everything have to do with capitalism nowadays? Racism, unsafe roads, hunger, bad weather, good weather, stubbing toes on furniture, etc. Don't believe me? See https://hn.algolia.com/?dateRange=all&page=0&prefix=false&query=%22abolish%20capitalism%22&sort=byDate&type=comment https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu... Are there any non-capitalist utopias out there without any problems like this?
- Retr0id 2y ago
  This is literally a discussion on allocation of capital, it's not a reach to say that capitalism might be involved.
  - cscurmudgeon 2y ago
    Right, so you draw a line from that to abolishing capitalism. Is that the only solution here? We need to destroy billions of lives so that we can potentially prevent "unsafe" super intelligence? Let me guess, your cure for cancer involves abolishing humanity? Should we abolish governments when some random government goes bad?
    - Retr0id 2y ago
      "Abolish" is hyperbole. Insufficiently regulated capitalism fails to account for negative externalities. Much like a Paperclip Maximising AI. One could even go as far as saying AGI alignment and economic resource allocation are isomorphic problems.
      - cscurmudgeon 2y ago
        Agreed. At the same time, regulators too need regulation. From history, governments have done more physical harm (genocides, etc) than capitalist companies with advanced tech (I know Chiquita and Dow exist).
- jdthedisciple 2y ago
  To be honest these search results being months apart shows quite the opposite of what you're saying... Even though I agree with your general point.

That’s the first step towards returning to candlelight. So it isn’t a step toward safe super intelligence, but it is a step away from any super intelligence. So I guess some people would consider that a win.

yk 2y ago
Not sure if you want to share the capitalist system with an entity that outcompetes you by definition. Chimps don't seem to do too well under capitalism.
- next_xibalba 2y ago
  You might be right, but that wasn't my point. Capitalism might yield a friendly AGI or an unfriendly AGI or some mix of both. Collectivism will yield no AGI.
  - CRConrad 2y ago
    First good argument for collectivism I've seen in a long while.

ganyu 2y ago

One can already see the beginning of AI enslaving humanity through the establishment. Companies work on AI get more investment and those who don't gets kicked out of the game. Those who employ AI get more investment and those who pay humans lose confidence through the market. People lose jobs, get harshly low birth rates while AI thrives. Tragic.

nemo44x 2y ago
So far it is only people telling AI what to do. When we reach the day where it is common place for AI to tell people what to do then we are possibly in trouble.

speed_spread 2y ago

And then seize the means of production.

cscurmudgeon 2y ago

Why does everything have to do with capitalism nowadays? Racism, unsafe roads, hunger, bad weather, good weather, stubbing toes on furniture, etc. Don't believe me? See https://hn.algolia.com/?dateRange=all&page=0&prefix=false&query=%22abolish%20capitalism%22&sort=byDate&type=comment https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu... Are there any non-capitalist utopias out there without any problems like this?

Retr0id 2y ago
This is literally a discussion on allocation of capital, it's not a reach to say that capitalism might be involved.
- cscurmudgeon 2y ago
  Right, so you draw a line from that to abolishing capitalism. Is that the only solution here? We need to destroy billions of lives so that we can potentially prevent "unsafe" super intelligence? Let me guess, your cure for cancer involves abolishing humanity? Should we abolish governments when some random government goes bad?
  - Retr0id 2y ago
    "Abolish" is hyperbole. Insufficiently regulated capitalism fails to account for negative externalities. Much like a Paperclip Maximising AI. One could even go as far as saying AGI alignment and economic resource allocation are isomorphic problems.
    - cscurmudgeon 2y ago
      Agreed. At the same time, regulators too need regulation. From history, governments have done more physical harm (genocides, etc) than capitalist companies with advanced tech (I know Chiquita and Dow exist).
jdthedisciple 2y ago
To be honest these search results being months apart shows quite the opposite of what you're saying... Even though I agree with your general point.