4 ms·
> Every time I see Yudkowsky’s writing I wonder why people take him seriously. Its a perfect thing for rich, extremely privileged people to grab onto as a caus
by dragonwriter 3y ago
> Every time I see Yudkowsky’s writing I wonder why people take him seriously.
Its a perfect thing for rich, extremely privileged people to grab onto as a cause to present thenselves as (and maybe even feel like they are, depending on their capacity for self-delusion) “doing something for humanity” while continuing to ignore the substantive material condition of, as a first order approximation, everyone in the world, and their role in perpetuating it.
- 0x00_NULL 3y agoI lost total interest in every “Stop” argument when Elon Musk started a company to develop AGI during the pause that he signed on to and promoted. Yann LeCunn said that this was just an attempt to seize market share among the big companies and he couldn’t have been more right.
- pclmulqdq 3y agoThat is transparently what this letter is for most of its signatories. They lost the race (in one way or another) and they want time to catch back up. This is as true for the academics who made big contributions in the past but missed out on the latest stuff as it is for Elon Musk.
- nineteen999 3y agoThe joke will be on them when our open-source powered mechwarriors made of bulldozer parts come for them.
- TeMPOraL 3y agoThe joke will be on us all when your open-source powered mechwarriors start destroying dams and power plants and even take a stab at launching some nukes, because the models figured this is the most effective way to "get them", and weren't aligned enough to see why they should take a different approach.
- nineteen999 3y agoWhile my tongue was firmly in my cheek, and still is somewhat, whats to stop (for example) Boston Dynamics and OpenAI collaborating and beating us to your nightmare scenario first? And is that a situation you would prefer?
- TeMPOraL 3y agoOf course not. I'm leaning towards Yudkowsky's recommendation, which is to put a pause on all of it.
- pclmulqdq 3y agoI have a bridge to sell Yudkowsky and everyone else who believes that an "AI pause" is actually something that can happen. Global treaties pretty much all occur with implied threats of violence, and we don't have enough guns to force this across India, China, the middle east, the EU, and the US. Major AI development happens in all of those places.
- TeMPOraL 3y agoYou're reading this wrong. Yudkowsky isn't saying that this will happen; in fact, it's apparent to him as much as to everyone else how unlikely is that. Yudkowsky's point is that this is the minimum and least difficult thing we need to do. LeCun and others on both sides of the "AI regulation" argument are busy arguing the color of the carpet, while the whole house is on fire.
- pclmulqdq 3y agoI think we all also fundamentally disagree about whether the house is on fire at all. History is littered with examples of Luddites yelling about how the bottom of a technological S-curve is actually an exponential and how we Must Do Something to prevent a catastrophe. With possibly one exception (biological weapons, research on which seems to have few positive externalities) they have always been wrong. I did not mean nuclear weapons - we are seeing significant negative societal fallout from failing to invest in nuclear technology. So no, the house is almost certainly not on fire.
- robotnikman 3y ago[flagged]