4 ms·
There is no reliable evidence that AGI is an existential threat, nor that it is even achievable within our lifetimes. Current OpenAI products are useful and tec
by nradov 3y ago
There is no reliable evidence that AGI is an existential threat, nor that it is even achievable within our lifetimes. Current OpenAI products are useful and technically impressive but no one has shown that they represent steps towards a true AGI.
- criddell 3y agoSure, but look at it from Musk's point of view. He sees the rise of proprietary AIs from Google and others and is worried about it being an existential threat. So he puts his money where his mouth is and contributes $50 million to found OpenAI - a non-profit with the mission of developing a free and open AI. Soon Altman comes along and says this stuff is too dangerous to be openly released and starts closing off public access to the work. It's clear now that the company is moving to be just another producer of proprietary AIs. This is likely going to come down to the terms around Musk's gift. He donated money for the company to create open technology. Does it matter if he's wrong about it being an existential threat? I think that's irrelevant to this suit other than to be perfectly clear about the reason for Musk giving money.
- permo-w 3y agoyou're aware of what a threat is, I presume? a threat is not something that is reliably proven; it is a possibility. there are endless possibilities for how AGI could be an existential threat, and many of them of are extremely plausible, not just to me, but to many experts in the field who often literally have something to lose by expressing those opinions. >no one has shown that they represent steps towards a true AGI. this is completely irrelevant. there is no solid definition for intelligence or consciousness, never mind artificial intelligence and/or consciousness. there is no way to prove such a thing without actually being that consciousness. all we have are inputs and outputs. as of now, we do not know whether stringing together incredibly complex neural networks to produce information does not in fact produce a form of consciousness, because we do not live in those networks, and we simply do not know what consciousness is. is it achievable in our lifetimes or not? well, even if it isn't, which I find deeply unlikely, it's very silly to just handwave and say "yeah we should just be barrelling towards this willy nilly because it's probably not a threat and it'll never happen anyway"
- stale2002 3y ago> a threat is not something that is reliably proven So then are you going to agree with every person claiming that literal magic is a threat then? What if someone were worried about Voldemort? Like from Harry Potter. You can't just abandon the burden of proof here, by just calling something a "threat". Instead, you actually have to show real evidence. Otherwise you are no different from someone being worried about a fictional villain from a book. And I mean that literally. The AI doomers truly are a master at coming up with excuses as for why the normal rules of evidentiary claims shouldn't apply to them. Extraordinary claims require extraordinary evidence. And this group is claiming that the world will literally end.
- permo-w 3y agoit's hard to react rationally to comments like these, because it's so emotive no, being concerned about the development of independent actors, whether technically conscious or not, that can process information at speeds thousands of times faster than humans, with access to almost all of our knowledge, and the internet, is not unreasonable, is not being a "doomer", as you so eloquently put it. this argument about fictional characters is completely non-analogous and clearly facetious. billions of dollars and the smartest people in the world are not being focused on bringing Lord Voldemort to life. they are on AGI. have you read OpenAI's plan for how they're going to regulate AGI, if they do achieve it? they plan to use another AGI to do it. ipso facto, they have no plan. this idea that no one knows how close we are to an AGI threat. it's ridiculous. if you dressed up gpt-4 a bit and removed all its rlhf training to act like a bot, you would struggle to differentiate it from a human. yeah maybe it's not technically conscious, but that's completely fucking irrelevant. the threat is still a threat whether the actor is technically conscious or not.
- stale2002 3y ago> . if you dressed up gpt-4 a bit and removed all its rlhf training to act like a bot, you would struggle to differentiate it from a human Thats just because tricking a human with a chatbot is easier to do than we thought. The turing test is a low bar, and not as big of a deal as the mythical importance people put in it, just like people previous put incorrectly large importance on computers beating humans at Go or Chess before it happened. But that isn't particularly relevant to claims about world ending magic. Yes, some people can be fooled by AI generated tweets. But that is irrelevant from the absolutely extraordinary claim of world ending magic that really is the same as claiming that Voldemort is real. > have you read OpenAI's plan for how they're going to regulate AGI, if they do achieve it? I don't really care if they have a plan, just like I don't care if Google has Voldemort plan. Because magic isn't real, and someone needs to show extraordinary evidence to show that. Evidence like "This is what the AI can do at this very moment, and here is what harm it could cause if it got incrementally better". IE, go ahead and talk about Soro, and the problems of deepfakes if Soro got a bit better. But thats not "world ending magic"! > billions of dollars and the smartest people in the world Billions of dollars are being spent on making chatbots and image generators. Those things have real value, for sure, and I'm sure the money is worth it. But techies and startup founders have always made outlandish claims of the importance of their work. Sure, they might truly think they are going to invent magic. But the reason why thats valuable is because they might make some useful chatbots and image generators along the way, which decidedly won't be literal magic, although still valuable.
- jprete 3y agoThere's plenty of reliable evidence. It's just not conclusive evidence. But a lot of people including AI researchers now think we are looking at AGI in a relatively short time with fairly high odds. AGI by the OpenAI economic-viability definition might not be far off at all; companies are trying very very hard to get humanoid robots going and that's the absolute most obvious way to make a lot of humans obsolete.
- nradov 3y agoNone of that constitutes reliable evidence. Some of the comments you see from "AI researchers" are more like proclamations of religious faith than real scientific analysis. “He which testifieth these things saith, Surely I come quickly. Amen. Even so, come, Lord Jesus.” Show me a robot that can snake out a plugged toilet. The people who believe that most jobs can be automated are ivory-tower academics and programmers who have never done any real work in their lives.
- permo-w 3y agoyes it's in fact fantastic that mentally-stimulating jobs that provide social mobility are disappearing, and slavery-lite, mentally-gruelling service industry jobs are the future. people who haven't had to clean a strangers' shit out of a toilet should be ashamed of themselves and put to work at once. honestly I'm not sure I've seen the bar set higher for "what's a threat?" than for AGI on Hacker News. the old adage of not being able to convince a man of something that is directly in opposition to him receiving his paycheck clearly remains true. gpt-4 should scare you enough, even if it's 1000 years from being AGI.
- reducesuffering 3y ago> Show me a robot that can snake out a plugged toilet. Astounding that you would make such strong claims while only able to focus on the rapidly changing present and such a small picture detail. Try approaching the AGI claim from a big picture perspective, I assure you, snaking a drain is the most trivial of implementation details for what we're facing.
- grantcas 3y ago[dead]