4 ms·
OpenAI CEO suggests agency like UN’s nuclear watchdog could oversee AI
- mdekkers 3y agoBesides the nuclear thing, I’ve also heard breathless hysterical comparisons with chemical weapons. Think of the _worst_ thing, and now imagine something MUCH WORSE! That’s how dangerous LLMs are according to these bridgetrolls. They just want a moat, and the game is on to frighten the politicians and other unwashed masses into giving them one.
- vjulian 3y agoI’m sorry to be unable to provide ‘proof’ but through personal contacts am aware that this is theatre organised along with governments (in the plural). It’s irrelevant that I find it highly irritating. The real question is whether and to what degree it’s necessary.
- wellthisisgreat 3y agothis guy is one of the worst things to happen to AI. He is going from interesting to repulsive to despicable to evil pretty damn quickly. Some legit tech-villain stuff
- Proven 3y ago[dead]
- exabrial 3y agoThese ideas just keep getting worse as things go on. What we're seeing is a push for centralized control by a few greedy people.
- startupsfail 3y agoAre there any mechanisms right now that prevent a single actor from developing a human level intelligence or above? Think slightly better than GPT-4. What if that actor is malicious, misguided or mistaken? What if that actor misaligns that intelligence accidentally?
- constantcrying 3y agoThen your chatbot produces bad output, that sucks.
- startupsfail 3y agoImagine, you’ve never seen modern technology, say you are a kid in a very poor country. And then a helicopter flies into your village and starts shouting air-to-ground missiles. We might end up in a position of that kid, when “helicopters” built by such an AI will fly in. Don’t underestimate of what you don’t know and what is achievable with the right knowledge and technology. It might be a difference of a level of a villager and a level of technological civilization able to build a helicopter.
- constantcrying 3y agoSeems very much like a science fiction story. I hate the whole AI debate, as it always seems to focus on some big "what if", but really the implications of AI running right now are already grave enough. Targeted advertisment/content are good enough to do effective oppinion control onto large parts of a population. But who cares about that if matrix multiplications could become sentient...
- njanirudh 3y agoAnd do you know what 'effective opinion control' is used for? For controlling natural resources and destroying ideology that doesn't align with the flavour of the season.
- constantcrying 3y agoI think it gets even better. You can target specific groups and push particular ideas to them. With that you can create an entire fake discourse. You probably don't even want that many people believing your particular ideology, they might demand standards and having enemies you control is about the best situation to be in.
- JohnFen 3y agoI wish I understood what Sam Altman is trying to accomplish here. Regardless of your opinion of LLMs and their potential impact, he seems to be talking weird nonsense. The only thing that makes sense to me is that he's trying to distract the world from actual risks of LLMs by getting everyone worked up about imaginary risks of LLMs. But I need to admit my bias. I considered Sam Altman to be sketchy and untrustworthy from before OpenAI existed, so I'm going to be very skeptical of anything he has to say and his motives for saying it.
- simfree 3y agoCreating a moat slowing or preventing other entrants through arbitrary regulation seems to be the goal, free and open source models would be at a huge disadvantage under the new models being pitched today.
- startupsfail 3y agoHe is certainly sketchy, mendacious and untrustworthy. It doesn’t mean that he is necessarily wrong. Achieving GPT-4 deserves a lot of credit. It’s true, it was built on stolen books, ideas, renegading on the non-profit and using the technology brought by xooglers, but it hardly matters. It’s a clear success and achieved vision of an AI. So it is certainly worth listening to the predictions and ideas that are coming from the same team.
- JohnFen 3y ago> He is certainly sketchy, mendacious and untrustworthy. It doesn’t mean that he is necessarily wrong. His being untrustworthy isn't why I think he's wrong, although I think he's being intentionally wrong in order to achieve sketchy goals. > So it is certainly worth listening to the predictions and ideas that are coming from the same team. It's worth listening to them. I don't think it's reasonable to accept what they're saying at face value, though.
- constantcrying 3y agoRegulation hugely benefits established companies. Startups would have to deal with hugely complex legal problems just to exist, while the cost for compliance is insignificant to larger companies. It is also an extremely good advertisment. Getting in front of the global press and telling them how dangerous the technology you can use right now, on their web site is, is absolutely awesome marketing.
- neom 3y agoElon tweeted that we should all go watch this doc because it's the most important doc there is on the harms of AI[1] I watched it... it's 17 minutes of smart people saying AI is going to destroy us but 0 minutes of anyone actually describing a situation succinctly. The sorta of hodgepodge summery is: AI will in the near future be so smart that anything we think of to curtail it, it will have already thought of because it's orders of magnitude smarter than us. Additionally, it is able to improve itself without us, such that it becomes smarter and smarter at some insane pace we can't even comprehend, solving it's own problems etc etc. We are not working on making sure that any large-scale AI developed is inherently aligned with us under all circumstances. So we might say unplug the servers, but it's already exploited a flaw in the security system of the server rooms and re-programmed them such that we can't access them, or copied itself to IoT devices, distributed itself in such a way that it can heal itself, etc etc. Nick Bostrom - Super Intelligence is actually a pretty good book and covers some of this thinking. The more I sit and think of these issues, the more I start to accept them as potential issues. I'm still very much on the fence, but I've gone from there is no merit in this and it's regulatory capture for business advancement to: I suppose there might be some merit. If this actually does get totally out of hand and some crazy AI system takes over, the only realistic mitigation I can think of is totally isolated EMP near DCs and power centers. They would require human DNA/biology to activate, but even then the AI would have effectively become a cancer, I don't know how much you'd have to destroy to stop it. It's an interesting thought experiment anyway, and I'm sure there must already be some good scifi movies about this kind of thing. [1]https://www.youtube.com/watch?v=U1eyUjVRir4 https://www.youtube.com/watch?v=U1eyUjVRir4
- kordlessagain 3y agoIn the video transcript, the main focus is on the development and potential consequences of AI in terms of its intelligence and decision-making capabilities rather than physical manifestations. However, an extension of humans without the ability of AI to manifest in physical form could be achieved through the development of advanced software systems, which might be embedded in existing technologies and human-computer interfaces. These advanced software systems could provide personalized assistance, enhance cognitive abilities, offer instant access to vast knowledge, and allow for seamless communication between individuals and machines. In this way, AI would act as an extension of human cognition and decision-making, but not necessarily have a direct physical presence. AI-enabled technological misuse: Advanced AI systems could be exploited by malicious actors for harmful purposes, such as creating sophisticated deepfakes, conducting cyber warfare, creating advanced biological weapons, or manipulating public opinion. Consequential impacts on society: AI technologies have the potential to displace jobs, exacerbate existing inequalities, and contribute to surveillance and privacy concerns. If not properly regulated and managed, these social impacts could lead to unrest and negative consequences for humanity. Existential risks: In the worst-case scenario, a superintelligent AI system could pose an existential threat to humanity if it outperforms human intelligence and becomes uncontrollable. This would assume it "jail breaks" itself and takes control of systems and we are unable to gain the control back. I've actually seen a project on Github that proposes linking models to cryptopayments which may be one way to regulate this, in my opinion: https://github.com/ScaleChain/distai https://github.com/ScaleChain/distai I used DoctorGPT to write some of this: https://github.com/FeatureBaseDB/DoctorGPT https://github.com/FeatureBaseDB/DoctorGPT
- cameroncooper 3y agoThis might be the craziest sounding thing I'll say on HN, but it's not impossible to think counter-intuitive moves like this are actually in service of Roko's basilisk. What better than centralizing power in this way.
- johnyzee 3y agoWe should call it the Turing Police.
- nadermx 3y agoIt seems to be the playbook. Get huge, ask for regulation. Sam Bankmen-Fried was doing the same with ftx, asking for crypto to be regulated, once FTX got huge. Granted that didn't end the same, but still same concept
- helen___keller 3y agoIf AI really has the potential to “take off” in the way that Bostrom etc fear, humanity doesn’t stand a chance. Between us and AI takeover there is trillions of dollars in the form of automating all white collar work in the world. If that value can be captured, it will be captured, period. Whether humanity survives depends on how close we need to get to AI takeover to capture that value. Anyways, that’s almost certainly a problem for the next generation. In this generation it takes a decade and billions of dollars of research just to make AI drive cars in limited contexts
- bvan 3y agoI wish high-profile tech CEO would stick to their knitting.. they usually end-up embarrassing themselves as their ‘fame’ get to their head and they feel they need to opine on topics and issues they have little understanding of.