4 ms·
This whole thing is like leaving 20 kids alone in a room with a marshmallow each and telling them don't eat it. ...and then expecting all of them resist. The
by Havoc 4y ago
This whole thing is like leaving 20 kids alone in a room with a marshmallow each and telling them don't eat it.
...and then expecting all of them resist.
The debate around whether we should tell the kids not to eat it and for what reasons is completely academic. Practically this just isn't happening.
- dandellion 4y agoIf they're really so worried about it they should start raiding data centres yesterday, writing open letters is such an obvious waste of time that I have a hard time taking it seriously.
- lkbm 4y agoAcademics, businessmen, and other non-governmental entities are usually better off advocating for the government to enact regulations than engaging in paramilitary action on their own. Do you think Extinction Rebellion is doing more to fight climate change than the people working with governments to enact good climate policy? Do you think PETA is helping animal well-fare more than more than the various organizations recommended by animalcharityevaluators.org? Serious people don't engage in terrorism because the issue is serious. They try to convince the existing power structures to take action.
- dandellion 4y agoI don't think it's so strange to expect the reaction to be proportionate to the threat they see? An open letter seems several orders of magnitude shorter to anything that would be effective if it really is a threat to the species. I think of examples of ways people react when there are very high stakes: resigning in protest, going on a hunger strike, demonstrations/raids, setting themselves on fire, etc. But there's none of that, just a low-stakes open letter? Can we even tell that apart from just posturing? Even the comments saying that some of the signers are just interested in delaying others for their own benefit are making better arguments.
- lkbm 4y agoI agree there's a lot more than "sign an open letter" they could be doing. I'm mostly objecting to the "they need to engage in terrorism or they're not serious" assertion. As for resigning in protest, my understanding is that Anthropic was founded by people who quit OpenAI saying it was acting recklessly. That seems like the best skin-in-the-game signal. I find that much more compelling than I would the Unabomber route. People like Musk and Woz should probably be pouring money into safety research and lobbying, but I don't think a hunger strike from anyone would make a difference, and resigning only makes sense if you work for OpenAI, Google, or a handful of other places where most of these people presumably don't work. What should I, an employee of a company not developing AI be doing? The only reasonable actions I can see are 1. work on AI safety research, 2. donate money to AI safety research/advocacy, and 3. sign and open letter. (I did none of these, to be fair, and am even giving a monthly fee to OpenAI to use ChatGPT with GPT-4), but my partner, an AI researcher who is seriously concerned, tried to sign the letter pit was ratelimited at the time], and is considering working in AI safety post-graduation. If she weren't making a PhD-student's salary, she might be donating money as well, though it's not super-clear where to direct that money.)
- dandellion 4y agoYes, engaging in terrorism would be too much for most signers in the list, but the point is more that there is a wide gap between what they're saying and what they're doing. You make another good point that at the very least, they should be putting their money where they mouth is. Anthropic seem to be competing against OpenAI? And getting funds from Google? So they would probably benefit economically from delaying development, since they are currently behind. Personally I think it's more important to look at what people are doing, than just listening to what they say, as there is a strong tendency to posturing.
- mrob 4y agoIf a terrorist bombs one data center, security increases at all the other data centers. Bombing all data centers (and chip fabs, so they can't be rebuilt) simultaneously requires state-level resources.
- cableshaft 4y ago> Do you think Extinction Rebellion is doing more to fight climate change than the people working with governments to enact good climate policy? I don't think either have been very effective, at least not recently (getting CFCs banned in the 90s was pretty cool though). And certainly not on the scale that's required at this stage. > Serious people don't engage in terrorism because the issue is serious. They try to convince the existing power structures to take action. And the existing power structures dig in their heels, or put on a big show of making changes while really doing almost nothing, or cede some ground for a few years, and then pay to get someone in political power who will reverse all that progress, so that no action ever really gets taken. Fun!
- dwaltrip 4y agoIndeed, academics and researchers are well-known for their high-stakes special ops capabilities.
- jrootabega 4y agoOr, to paint the parties as less innocent, it would be like the pull out method of technological protection. No no no, I promise not to convolve in your model...
- streblo 4y agoIs there a phrase for when someone proposes something utterly ridiculous and impossible, so that they can morally grandstand and be sanctimonious when it inevitably doesn't happen?
- flangola7 4y agoYou can't grandstand if you're dead
- jillesvangurp 4y agoIt's a good analogy. Especially considering some of the kids might have "parents" that are not based in the US that are very unlikely to just go and sit on their hands for six months just because some people from the US want them to. It's beyond naive to assume that the rest of the world would agree to do nothing. I don't see that happen. BTW. I suspect the reasons for this open letter might be a bit disingenuous. A few of the people that signed it represent companies that are effectively competing with OpenAI. Or failing to, rather. They are calling for them to slow down so they can catch up. It's not about saving humanity but about giving themselves a chance to catch up and become part of the problem.
- hollerith 4y agoIt more like asking the US government to get involved and if one of the 20 kids keeps on eating marshmallows, large numbers of federal agents raid the kid's offices and shut down the kid's compute resources.
- pjkundert 4y agoIt’s more like sending the cops to raid every house with a marshmallow (Mac M2) because they might run a local copy of an LLM. This isn’t about “dangerous” LLMs. This is about unfettered LLM in the hands of the unwashed masses that actually tell the truth about what they find in their training datasets…
- hollerith 4y agoAIs running on Macs are not a danger (and if ChatGPT were going to kill everyone it would've done it already): it is the AIs running on huge farms of GPUs or TPUs that are being planned that are the danger. Also, the author (Eliezer Yudkowsky) calling for the shutdown of AI research on huge server farms doesn't have any stake (investment or employment relationship) in any AI company that would be harmed by telling the truth about what they find in their training datasets.
- Havoc 4y ago>It more like asking the US government to get involved US gov has direct jurisdiction over 4% of the worlds population and some pretty decent indirect influence over the other 96%. It's good, but nowhere enough to prevent secret marshmallow eating on a global scale. Not even close
- hollerith 4y agoMy impression is that most of the short-term danger is from AI researchers residing in the US (and of the remainder, most reside in Britain). But even if that were not true, as a US citizen, even if there is nothing I can do about my getting killing by, e.g., Chinese AI researchers, I'm still going to work hard to prevent the AI researchers living in my own country from ending the human race. I'm responsible for doing my part in the governance of my own country, they told me in high school. I see no good solution to this problem, no path to safety, but that does not mean I am not going to do what I can.