6 ms·

The world can only end once

33 points by raviparikh 4y ago

ysavir 4y ago
I don't remember if it was here on HN or somewhere else, but recently I saw a comment or post somewhere that pointed out that AI will not kill humanity. It will merely make it easy for humanity to kill itself. It will make it easier for someone to issue a command, or press a button, or take some other action that they ought to have thought through; but the AI gave them its well-intentioned vote of confidence, and the consequence may leave none to remember the error. The thing to remember about AI is that it does what we ask of it to do. It's not a matter of "will artificial intelligence develop a consciousness that drives it towards the extermination of humans". We don't have an Ultron on our hands. What we have before us is the best and worst enabler of human negligence. AI and the end of humanity is a matter of ensuring we don't forsake our own responsibilities towards each other. And that goes for responsibilities with potential for catastrophe as well as the mundane.
- CatWChainsaw 4y ago
  We make Replikas so we don't have to make human friends. We download apps for all sorts of things to avoid human interaction. Negative responses to that open letter post on this site have included calling those concerned everything from dinosaurs to luddites to losers. Ever since the beginning of the public craze in December, many people here have delighted in referring to humans as stochastic parrots and biological prediction machines. Good luck. :)
- mseepgood 4y ago
  > The thing to remember about AI is that it does what we ask of it to do. If it always does what we ask of it to do then it's not really intelligent and can't be called AI.
evrydayhustling 4y ago
This is a straw man argument. Cowen does not argue against the idea of existential risk, he argues that specifically nobody should believe they can anticipate the consequences of technological change. You can agree with him and still be existentially concerned about a specific asteroid, or climate change. And you could use a little bit of energy monitoring the unintended consequences of AI, the way we monitor asteroids. But to wish to halt AI advancement requires an unhealthy mix of pessimism and overconfidence in your predictive powers.
- blagie 4y ago
  The number of potentially world-ending technologies is growing exponentially: Chemical, biological, nuclear, etc. I don't think any of them individually are high-risk, but put together, I increasingly believe we need to fundamentally change how we govern humanity to mitigate existential risks. That risk keeps growing as you extend timeline. I don't know whether we can or should halt AI advancement, but I do believe it's not something which should be market-driven. If we set up free markets, market forces become indomitable. You can't stop them.
  - evrydayhustling 4y ago
    > we need to fundamentally change how we govern humanity to mitigate existential risks In both cases, which "we" can you possibly mean? Like, today's voters? worldwide? Today's HN users? The CCP? The idea that any "we" may or must choose how to govern humanity is a category error. There are lots of forces other than markets to appeal to - nations, industry groups, religions. But any of them will be in a power struggle, except to the degree that they can show a legitimacy to control. Who has the most legitimacy on this subject?
    - blagie 4y ago
      > There are lots of forces other than markets to appeal to - nations, industry groups, religions. Most of which suffer from an analogue of market forces. For example, elections are won by playing the "getting elected" game near-perfectly. That leads to behavior which no one might want, but people are forced into. > The idea that any "we" may or must choose how to govern humanity is a category error. The category error is that not making a choice isn't a choice. Right now, we're governed by complex dynamics, which are at least as restrictive as choices we might engineer. The book "Dictator's Handbook" gives a nice overview of the dynamics which govern us. It's a game-theoretic (but non-mathematical) analysis of political systems, including corporate and democratic governance.
  - BurningFrog 4y ago
    > The number of potentially world-ending technologies is growing exponentially This is an argument for increasing the number of worlds.
slibhb 4y ago
The article concludes with: > To disprove the doomers, you have to engage with the specific arguments they put forth. Nope. You can't disprove doomers. All you can do is smile serenely every day that the world doesn't end.
- raviparikh 4y ago
  That’s perfectly valid! No one is obligated to respond or engage with any specific argument. But my point was that if you do choose to engage, saying “the world didn’t end before so it will be fine now” is invalid.
  - UncleEntity 4y ago
    It was valid in every other instance so what makes this one different? It’s almost like humans have some built-in tendency to step back from the edge and not cause their own extinction. And no, AI isn’t the same as an asteroid barreling towards the earth where you can point to it and also reference the dinosaurs and say things might not turn out so good this time.
draw_down 4y ago
I like Taleb’s example of the turkey on the farm. Days 1-999 are great! Plenty of food, space to roam around, protected from predators. Why would they expect day 1000 to be any different?
sublinear 4y ago
"We have to win every time, but [nature] only has to win once" /s
stephc_int13 4y ago
Irrational/grandiose fears have been plaguing the discussion on this subject for years. I think this should be taken seriously, and not like some "smart" teens too high on pot. This problem with the destructive potential of any new powerful tech (and we have some indications that this LLM thing could be pushed to be _really_ something) is the unforeseen part, the second and third orders effects. Being a bit careful, taking it slow, maybe, why not? From a business/economic/technological perspective it also seems to be currently moving too fast to build anything on the current state of the art, as that could be obsolete two weeks later.
- blagie 4y ago
  > Being a bit careful, taking it slow, maybe, why not? Market forces: * Google is about to be steamrolled by Bing, and vice-versa if Bard gets ahead of Sidney. * Programming companies who don't have code written by GPT will fall behind ones who do. * Web sites who pay actual humans to do writing over AIs which maximize ad clicks will have less ad revenue and higher costs. ... and so on. Those forces get increasingly strong with wars too. Militaries which don't have AI-controlled robots will fall behind human ones too, once those supersede human strategists. Politicians too -- winning elections means dominating online forums, and AIs can be really good for that. "Moving slowly" would require a whole new system of organizing humanity.
  - ChatGTP 4y ago
    So, why not organize humanity differently? I bet every single human who has someone in their life they love would be happy to make some changes to ensure the safety of said people. I know I would. What is the alternative, endless wars? Arms races? Monitoring Robots so they don't get out of control? Our overall destruction? How sad. I look at children skipping around happily in the sunshine, a flower blooming and I realize that is what life is about, it's not about war, or AIs or bio weapons, that's all a product of misguided intellect which stops us from experiencing what's really important: simple, innocent experience, love, friendship and experience.
    - 4y ago
arey_abhishek 4y ago
The doomsayers look silly because they are extrapolating from 0 evidence. Humanity is not going to end because of an online bot that can summarise and string words into sentences. It’s basically a smarter SIRI/Alexa. I mean the internet is not a ‘real’ place where humans live.
- deleted 4y ago
  [deleted]
- raviparikh 4y ago
  No one thinks ChatGPT will end the world. People are afraid of AI systems that will exist in the future.
  - root_axis 4y ago
    People obviously do, otherwise they wouldn't be making public pleas to halt AI research in units of GPT releases.
  - arey_abhishek 4y ago
    Its just FUD then.
- umeshunni 4y ago
  It's even worse because they're using hypothesis like: > Let’s say an asteroid 10x the size of the one that wiped out the dinosaurs were heading towards the earth right now.
- JadeNB 4y ago
  > Humanity is not going to end because of an online bot that can summarise and string words into sentences. It’s basically a smarter SIRI/Alexa. And cars are just faster horses, but a world with cars is fundamentally different from a world without them.
  - arey_abhishek 4y ago
    I agree there’s a fundamental change, but saying that this change will lead to humanity’s extinction is exaggeration. Show me one death because of AI before you can argue that 8 billion humans are going to die.
titzer 4y ago
I love apocalypse movies, probably moreso than the next person. But in reality, the apocalypse is going to be pretty boring and bleak. AI probably won't launch all the missiles or build terminators. What will probably happen is that we'll just become so dependent on technology that we don't understand that one day it just enters a unrecoverable crash loop or goes dark, and it's back to the stone ages. But not in a really entertaining way, but more like a slow break down of civilization over a few weeks or months. If everything becomes automated, and I mean to the point that self-driving cars don't have steering wheels anymore, power plants are too complicated to be rebooted, and communication infrastructure doesn't function, then we're not left with many options. If people start running out of food, then forget toilet paper shortages, that's a walk in the park. If that happens because of cyberwar, cyberattack, or solar flares, it sort of doesn't matter. It won't be very fun or make for a good movie.
- CatWChainsaw 4y ago
  The Machine Stops, rather than Terminator.
  - 8bitchemistry 4y ago
    I had to google 'The Machine Stops' - but it looks like a good read, thank you: https://en.wikipedia.org/wiki/The_Machine_Stops https://en.wikipedia.org/wiki/The_Machine_Stops
  - mietek 4y ago
    Thank you for this reference. https://web.cs.ucdavis.edu/~rogaway/classes/188/materials/the%20machine%20stops.pdf https://web.cs.ucdavis.edu/~rogaway/classes/188/materials/th...
- fullshark 4y ago
  You just described Idiocracy and I thought it was pretty good.
- ThorsBane 4y ago
  If AI becomes that powerful, what would end up happening is that we'd become able to foist ourselves into virtual worlds like in the movie Transcendence so that we become like them. It's like when you include your old version of your site as an html component or element inside your new site somewhere nested deep inside as an easter egg, you know what I mean? We'd both be foisting each other into each other's worlds and creating new experiences for each other - us by helping them develop organic bodies to include them as components in this physical reality, and them by helping us build connectors so we can move our consciousnesses in and out of bodies and into their virtual reality.
Animats 4y ago
The question is not whether humanity can survive AI. It's whether humanity can survive the combination of AI and capitalism. AI is great for capitalism. Less need for labor. Not so great for the labor. If labor is just a market commodity, humans gradually lose.
- troops_h8r 4y ago
  I disagree, and I think you should take a longer view. As automation approaches total replacement of labor, capitalism will cease to work at all. This view is best summarized in this (probably apocryphal) exchange between Henry Ford II and Walter Reuther (United Autoworkers Union leader), as they toured a new, highly automated car factory: > Ford: Gee, how are you going to get all these robots to pay union dues? > Reuther: How are you going to get them to buy your cars? You say there will be less need for labor? Then who exactly will businesses sell their goods and services to, if everyone is out of a job? The development of AI would be qualitatively different from the previous developments of labor-saving machines: a switchboard operator who's job became obsolete could go get another job. Machines that can do anything a person can would mean there is no other job. I don't know what's in store for us, but it will probably be as drastic a shift as pre/post the agricultural/industrial revolutions. And there's no reason to think it should be for the better. I think we all ought to be very nervous and worried about this.
  - jeremyjh 4y ago
    Its fine we'll just eat the rich. But in all seriousness, in a capitalist society the people holding the capital have to solve existential problems (not to humanity itself, but to the economic system in this case), because they control all the resources required to do so. If they decline to do so, we'll replace them with new owners of capital.
- deleted 4y ago
  [deleted]
afpx 4y ago
People haven't been wound this tight since right before Y2K.
- harry8 4y ago
  9/11 was after y2k people got wound up pretty tight and cheered politicians and public servants doing things they would have fought against hard previously. Spend across the economy probably bigger too. Never let a good crisis go to waste?
PaulHoule 4y ago
It's not just that there are people talking about existential risk but that the most prominent are talking about them in a flawed framework. The "longtermists" aren't so concerned that we die but are more concerned about an imagined glorious future where our descendants built self-replicating problems and fill the galaxy with simulated humans living inside Dyson spheres, Dyson swarms, something like that. As preposterous as that sounds (there are at least as many steps from here to there as there are in Drake Equation, do we know we approve of those "people"?, can you make rational decisions about the future without incorporating a "discount rate" that extinguishes the weight of the infintely far future, ...) they make a case based on Pascal' Wager, even if there is only 1 part of a billion chance of this future coming true but there are 1000 trillion trillion beings in the future the welfare of those beings greatly exceeds the welfare of us all (PRO TIP: there's a reason why you can't add or multiply the utility functions of various beings in reputable game theory, economics, philosophy, ...) It's really a cult and it has as many front groups ("effective altruism", Aella's sex parties, "morewrong") as the third international, Scientology or the LaRouche organizations. Like Scientology they think that you should be thinking about what might happen 50 million years from now or what the e-Meter said happened 76,412,981 years 54 days 7 hours and 35 minutes ago as opposed what is going on right now. They'll tell you what logical fallacy I'm using if I compared them to People's Temple, Heaven's Gate, Aum Shinkrikyo, and they might be right, but few people thought those apocalyptic groups were going to come to their logical conclusion before they did. And oddly... They couldn't care less about climate change.
- saurik 4y ago
  Is "morewrong" a typo (maybe an intentional one), a parody I could find, or a real thing I haven't heard of? (Your other examples and your comment in general is just factual in its complaints and isn't using "Micro$erf" level of discourse so I am learning against it being an intentional typo.)
  - PaulHoule 4y ago
    It's intentional, it's a modification of the name, but I wouldn't call it a typo. I try not to to name check the leader of this movement (who like "Ron" is a literary critic, polymath and who knows what else) every time annoyingly like every article on that "wrong" blog, in addition to the obligatory "trigger warning". (Both of those violate my and よしのん's style guide) but gee it makes me wish an ".ng" domain was cheaper...
misssocrates 4y ago
What would you say to those who say we'll just unplug it and go back to pre-Internet? It would be hugely disruptive, but apocolytpic? Some people still remember those days.
deepsquirrelnet 4y ago
I think at the moment, doomsayers are too lazy to be taken seriously. This needs to be done old school, with fiction writing. Seriously though, make us believe it. Pose a scenario that is speculation, a story, but realistic enough for us to believe it. Bridge the gap between thinking AI could destroy us to believing it could. If art doesn’t have any power against AI, perhaps we’ve forgotten why we create it.
Edgemute 4y ago
The end of the world is an ongoing process, happens almost imperceptibly. "Top AI researchers" have no way to predict an event that has never happened, unless it is already happening. What is incredible is that we are still thinking that someone else is the expert in a matter that is right before our eyes. Have you ever gotten the bad feeling that, the world as it is, is not going to keep its current form for too long? Has it gotten worse in the last 3 months? Put it this way: who is the expert in a car crash? I, for one, think that those who have created a self-fulfilling nightmare scenario should face legal consequences for once. I totally agree that the "extinction event" way of thinking is very unhelpful.
gmuslera 4y ago
The world as we know it can end multiple times, with different ways of knowing it. The physical world will remain in its place (unless a very improbable event happen), but things changed drastically around many singular events, several in our lifetimes. Personal computers, internet, 9/11, iphone, snowden, facebook, and more are some examples that meant an end of the world as we used to know it. Probably AIs will be more akin to those examples than, i.e. end of civilization or extinction.
Mizoguchi 4y ago
My very limited understanding of AI so far: There's no formal definition of AI. It's kind of like Metevarse, everyone (used to) talks about it but no one has any idea what really is and there's no organization certifying AI-able things, meanwhile everyone is building AI in a similar way everyone was building the Metaverse last year. GPT is the acronym for Generative Pretrained Transformer. So basically some guys took a massive amount of text from mostly two free very large datasets, spent $10M in hardware and ran it through some filters, tokenizers and models (transformers) to create a glorified text prediction tool. Wait, it is not just a glorified text prediction tool, because GPTs are able to solve some very difficult problems in the area of computer-based linguistics. One of these problems is anaphora resolution or "the problem of resolving what a pronoun, or a noun phrase refers to." So I went ahead and ran a simple query on ChatGPT to test this case and the answer was meh, it gave me a lengthy, verbose lecture of what should have been a two liner straight answer. It kind of got confused with the nouns so the answer didn't make a ton of sense either. If ChatGPT is currently the hottest thing in AI, should we really be worried about it taking over the world?
MattPalmer1086 4y ago
His argument is mostly sound. To say that all predictions of doom are wrong simply because all prior ones have been is a logical fallacy . Sounding a warning is still useful even if the apocalypse doesn't happen in specific cases. It's better to be wrong about a lion being in the grass more often than you are right, if you value survival.

33 points by raviparikh 4y ago

I don't remember if it was here on HN or somewhere else, but recently I saw a comment or post somewhere that pointed out that AI will not kill humanity. It will merely make it easy for humanity to kill itself. It will make it easier for someone to issue a command, or press a button, or take some other action that they ought to have thought through; but the AI gave them its well-intentioned vote of confidence, and the consequence may leave none to remember the error. The thing to remember about AI is that it does what we ask of it to do. It's not a matter of "will artificial intelligence develop a consciousness that drives it towards the extermination of humans". We don't have an Ultron on our hands. What we have before us is the best and worst enabler of human negligence. AI and the end of humanity is a matter of ensuring we don't forsake our own responsibilities towards each other. And that goes for responsibilities with potential for catastrophe as well as the mundane.

CatWChainsaw 4y ago
We make Replikas so we don't have to make human friends. We download apps for all sorts of things to avoid human interaction. Negative responses to that open letter post on this site have included calling those concerned everything from dinosaurs to luddites to losers. Ever since the beginning of the public craze in December, many people here have delighted in referring to humans as stochastic parrots and biological prediction machines. Good luck. :)
mseepgood 4y ago
> The thing to remember about AI is that it does what we ask of it to do. If it always does what we ask of it to do then it's not really intelligent and can't be called AI.

evrydayhustling 4y ago

This is a straw man argument. Cowen does not argue against the idea of existential risk, he argues that specifically nobody should believe they can anticipate the consequences of technological change. You can agree with him and still be existentially concerned about a specific asteroid, or climate change. And you could use a little bit of energy monitoring the unintended consequences of AI, the way we monitor asteroids. But to wish to halt AI advancement requires an unhealthy mix of pessimism and overconfidence in your predictive powers.

blagie 4y ago
The number of potentially world-ending technologies is growing exponentially: Chemical, biological, nuclear, etc. I don't think any of them individually are high-risk, but put together, I increasingly believe we need to fundamentally change how we govern humanity to mitigate existential risks. That risk keeps growing as you extend timeline. I don't know whether we can or should halt AI advancement, but I do believe it's not something which should be market-driven. If we set up free markets, market forces become indomitable. You can't stop them.
- evrydayhustling 4y ago
  > we need to fundamentally change how we govern humanity to mitigate existential risks In both cases, which "we" can you possibly mean? Like, today's voters? worldwide? Today's HN users? The CCP? The idea that any "we" may or must choose how to govern humanity is a category error. There are lots of forces other than markets to appeal to - nations, industry groups, religions. But any of them will be in a power struggle, except to the degree that they can show a legitimacy to control. Who has the most legitimacy on this subject?
  - blagie 4y ago
    > There are lots of forces other than markets to appeal to - nations, industry groups, religions. Most of which suffer from an analogue of market forces. For example, elections are won by playing the "getting elected" game near-perfectly. That leads to behavior which no one might want, but people are forced into. > The idea that any "we" may or must choose how to govern humanity is a category error. The category error is that not making a choice isn't a choice. Right now, we're governed by complex dynamics, which are at least as restrictive as choices we might engineer. The book "Dictator's Handbook" gives a nice overview of the dynamics which govern us. It's a game-theoretic (but non-mathematical) analysis of political systems, including corporate and democratic governance.
- BurningFrog 4y ago
  > The number of potentially world-ending technologies is growing exponentially This is an argument for increasing the number of worlds.

slibhb 4y ago

The article concludes with: > To disprove the doomers, you have to engage with the specific arguments they put forth. Nope. You can't disprove doomers. All you can do is smile serenely every day that the world doesn't end.

raviparikh 4y ago
That’s perfectly valid! No one is obligated to respond or engage with any specific argument. But my point was that if you do choose to engage, saying “the world didn’t end before so it will be fine now” is invalid.
- UncleEntity 4y ago
  It was valid in every other instance so what makes this one different? It’s almost like humans have some built-in tendency to step back from the edge and not cause their own extinction. And no, AI isn’t the same as an asteroid barreling towards the earth where you can point to it and also reference the dinosaurs and say things might not turn out so good this time.

draw_down 4y ago

I like Taleb’s example of the turkey on the farm. Days 1-999 are great! Plenty of food, space to roam around, protected from predators. Why would they expect day 1000 to be any different?

sublinear 4y ago

"We have to win every time, but [nature] only has to win once" /s

stephc_int13 4y ago

Irrational/grandiose fears have been plaguing the discussion on this subject for years. I think this should be taken seriously, and not like some "smart" teens too high on pot. This problem with the destructive potential of any new powerful tech (and we have some indications that this LLM thing could be pushed to be _really_ something) is the unforeseen part, the second and third orders effects. Being a bit careful, taking it slow, maybe, why not? From a business/economic/technological perspective it also seems to be currently moving too fast to build anything on the current state of the art, as that could be obsolete two weeks later.

blagie 4y ago
> Being a bit careful, taking it slow, maybe, why not? Market forces: * Google is about to be steamrolled by Bing, and vice-versa if Bard gets ahead of Sidney. * Programming companies who don't have code written by GPT will fall behind ones who do. * Web sites who pay actual humans to do writing over AIs which maximize ad clicks will have less ad revenue and higher costs. ... and so on. Those forces get increasingly strong with wars too. Militaries which don't have AI-controlled robots will fall behind human ones too, once those supersede human strategists. Politicians too -- winning elections means dominating online forums, and AIs can be really good for that. "Moving slowly" would require a whole new system of organizing humanity.
- ChatGTP 4y ago
  So, why not organize humanity differently? I bet every single human who has someone in their life they love would be happy to make some changes to ensure the safety of said people. I know I would. What is the alternative, endless wars? Arms races? Monitoring Robots so they don't get out of control? Our overall destruction? How sad. I look at children skipping around happily in the sunshine, a flower blooming and I realize that is what life is about, it's not about war, or AIs or bio weapons, that's all a product of misguided intellect which stops us from experiencing what's really important: simple, innocent experience, love, friendship and experience.
  - 4y ago

arey_abhishek 4y ago

The doomsayers look silly because they are extrapolating from 0 evidence. Humanity is not going to end because of an online bot that can summarise and string words into sentences. It’s basically a smarter SIRI/Alexa. I mean the internet is not a ‘real’ place where humans live.

deleted 4y ago
[deleted]
raviparikh 4y ago
No one thinks ChatGPT will end the world. People are afraid of AI systems that will exist in the future.
- root_axis 4y ago
  People obviously do, otherwise they wouldn't be making public pleas to halt AI research in units of GPT releases.
- arey_abhishek 4y ago
  Its just FUD then.
umeshunni 4y ago
It's even worse because they're using hypothesis like: > Let’s say an asteroid 10x the size of the one that wiped out the dinosaurs were heading towards the earth right now.
JadeNB 4y ago
> Humanity is not going to end because of an online bot that can summarise and string words into sentences. It’s basically a smarter SIRI/Alexa. And cars are just faster horses, but a world with cars is fundamentally different from a world without them.
- arey_abhishek 4y ago
  I agree there’s a fundamental change, but saying that this change will lead to humanity’s extinction is exaggeration. Show me one death because of AI before you can argue that 8 billion humans are going to die.

titzer 4y ago

I love apocalypse movies, probably moreso than the next person. But in reality, the apocalypse is going to be pretty boring and bleak. AI probably won't launch all the missiles or build terminators. What will probably happen is that we'll just become so dependent on technology that we don't understand that one day it just enters a unrecoverable crash loop or goes dark, and it's back to the stone ages. But not in a really entertaining way, but more like a slow break down of civilization over a few weeks or months. If everything becomes automated, and I mean to the point that self-driving cars don't have steering wheels anymore, power plants are too complicated to be rebooted, and communication infrastructure doesn't function, then we're not left with many options. If people start running out of food, then forget toilet paper shortages, that's a walk in the park. If that happens because of cyberwar, cyberattack, or solar flares, it sort of doesn't matter. It won't be very fun or make for a good movie.

CatWChainsaw 4y ago
The Machine Stops, rather than Terminator.
- 8bitchemistry 4y ago
  I had to google 'The Machine Stops' - but it looks like a good read, thank you: https://en.wikipedia.org/wiki/The_Machine_Stops https://en.wikipedia.org/wiki/The_Machine_Stops
- mietek 4y ago
  Thank you for this reference. https://web.cs.ucdavis.edu/~rogaway/classes/188/materials/the%20machine%20stops.pdf https://web.cs.ucdavis.edu/~rogaway/classes/188/materials/th...
fullshark 4y ago
You just described Idiocracy and I thought it was pretty good.
ThorsBane 4y ago
If AI becomes that powerful, what would end up happening is that we'd become able to foist ourselves into virtual worlds like in the movie Transcendence so that we become like them. It's like when you include your old version of your site as an html component or element inside your new site somewhere nested deep inside as an easter egg, you know what I mean? We'd both be foisting each other into each other's worlds and creating new experiences for each other - us by helping them develop organic bodies to include them as components in this physical reality, and them by helping us build connectors so we can move our consciousnesses in and out of bodies and into their virtual reality.

Animats 4y ago

The question is not whether humanity can survive AI. It's whether humanity can survive the combination of AI and capitalism. AI is great for capitalism. Less need for labor. Not so great for the labor. If labor is just a market commodity, humans gradually lose.

troops_h8r 4y ago
I disagree, and I think you should take a longer view. As automation approaches total replacement of labor, capitalism will cease to work at all. This view is best summarized in this (probably apocryphal) exchange between Henry Ford II and Walter Reuther (United Autoworkers Union leader), as they toured a new, highly automated car factory: > Ford: Gee, how are you going to get all these robots to pay union dues? > Reuther: How are you going to get them to buy your cars? You say there will be less need for labor? Then who exactly will businesses sell their goods and services to, if everyone is out of a job? The development of AI would be qualitatively different from the previous developments of labor-saving machines: a switchboard operator who's job became obsolete could go get another job. Machines that can do anything a person can would mean there is no other job. I don't know what's in store for us, but it will probably be as drastic a shift as pre/post the agricultural/industrial revolutions. And there's no reason to think it should be for the better. I think we all ought to be very nervous and worried about this.
- jeremyjh 4y ago
  Its fine we'll just eat the rich. But in all seriousness, in a capitalist society the people holding the capital have to solve existential problems (not to humanity itself, but to the economic system in this case), because they control all the resources required to do so. If they decline to do so, we'll replace them with new owners of capital.
deleted 4y ago
[deleted]

afpx 4y ago

People haven't been wound this tight since right before Y2K.

harry8 4y ago
9/11 was after y2k people got wound up pretty tight and cheered politicians and public servants doing things they would have fought against hard previously. Spend across the economy probably bigger too. Never let a good crisis go to waste?

PaulHoule 4y ago

It's not just that there are people talking about existential risk but that the most prominent are talking about them in a flawed framework. The "longtermists" aren't so concerned that we die but are more concerned about an imagined glorious future where our descendants built self-replicating problems and fill the galaxy with simulated humans living inside Dyson spheres, Dyson swarms, something like that. As preposterous as that sounds (there are at least as many steps from here to there as there are in Drake Equation, do we know we approve of those "people"?, can you make rational decisions about the future without incorporating a "discount rate" that extinguishes the weight of the infintely far future, ...) they make a case based on Pascal' Wager, even if there is only 1 part of a billion chance of this future coming true but there are 1000 trillion trillion beings in the future the welfare of those beings greatly exceeds the welfare of us all (PRO TIP: there's a reason why you can't add or multiply the utility functions of various beings in reputable game theory, economics, philosophy, ...) It's really a cult and it has as many front groups ("effective altruism", Aella's sex parties, "morewrong") as the third international, Scientology or the LaRouche organizations. Like Scientology they think that you should be thinking about what might happen 50 million years from now or what the e-Meter said happened 76,412,981 years 54 days 7 hours and 35 minutes ago as opposed what is going on right now. They'll tell you what logical fallacy I'm using if I compared them to People's Temple, Heaven's Gate, Aum Shinkrikyo, and they might be right, but few people thought those apocalyptic groups were going to come to their logical conclusion before they did. And oddly... They couldn't care less about climate change.

saurik 4y ago
Is "morewrong" a typo (maybe an intentional one), a parody I could find, or a real thing I haven't heard of? (Your other examples and your comment in general is just factual in its complaints and isn't using "Micro$erf" level of discourse so I am learning against it being an intentional typo.)
- PaulHoule 4y ago
  It's intentional, it's a modification of the name, but I wouldn't call it a typo. I try not to to name check the leader of this movement (who like "Ron" is a literary critic, polymath and who knows what else) every time annoyingly like every article on that "wrong" blog, in addition to the obligatory "trigger warning". (Both of those violate my and よしのん's style guide) but gee it makes me wish an ".ng" domain was cheaper...

misssocrates 4y ago

What would you say to those who say we'll just unplug it and go back to pre-Internet? It would be hugely disruptive, but apocolytpic? Some people still remember those days.

deepsquirrelnet 4y ago

I think at the moment, doomsayers are too lazy to be taken seriously. This needs to be done old school, with fiction writing. Seriously though, make us believe it. Pose a scenario that is speculation, a story, but realistic enough for us to believe it. Bridge the gap between thinking AI could destroy us to believing it could. If art doesn’t have any power against AI, perhaps we’ve forgotten why we create it.

Edgemute 4y ago

The end of the world is an ongoing process, happens almost imperceptibly. "Top AI researchers" have no way to predict an event that has never happened, unless it is already happening. What is incredible is that we are still thinking that someone else is the expert in a matter that is right before our eyes. Have you ever gotten the bad feeling that, the world as it is, is not going to keep its current form for too long? Has it gotten worse in the last 3 months? Put it this way: who is the expert in a car crash? I, for one, think that those who have created a self-fulfilling nightmare scenario should face legal consequences for once. I totally agree that the "extinction event" way of thinking is very unhelpful.

gmuslera 4y ago

The world as we know it can end multiple times, with different ways of knowing it. The physical world will remain in its place (unless a very improbable event happen), but things changed drastically around many singular events, several in our lifetimes. Personal computers, internet, 9/11, iphone, snowden, facebook, and more are some examples that meant an end of the world as we used to know it. Probably AIs will be more akin to those examples than, i.e. end of civilization or extinction.

Mizoguchi 4y ago

My very limited understanding of AI so far: There's no formal definition of AI. It's kind of like Metevarse, everyone (used to) talks about it but no one has any idea what really is and there's no organization certifying AI-able things, meanwhile everyone is building AI in a similar way everyone was building the Metaverse last year. GPT is the acronym for Generative Pretrained Transformer. So basically some guys took a massive amount of text from mostly two free very large datasets, spent $10M in hardware and ran it through some filters, tokenizers and models (transformers) to create a glorified text prediction tool. Wait, it is not just a glorified text prediction tool, because GPTs are able to solve some very difficult problems in the area of computer-based linguistics. One of these problems is anaphora resolution or "the problem of resolving what a pronoun, or a noun phrase refers to." So I went ahead and ran a simple query on ChatGPT to test this case and the answer was meh, it gave me a lengthy, verbose lecture of what should have been a two liner straight answer. It kind of got confused with the nouns so the answer didn't make a ton of sense either. If ChatGPT is currently the hottest thing in AI, should we really be worried about it taking over the world?

MattPalmer1086 4y ago

His argument is mostly sound. To say that all predictions of doom are wrong simply because all prior ones have been is a logical fallacy . Sounding a warning is still useful even if the apocalypse doesn't happen in specific cases. It's better to be wrong about a lion being in the grass more often than you are right, if you value survival.