6 ms·
OpenAI CEO warns that GPT-4 could be misused for nefarious purposes
- TamDenholm 4y agoNot that im defending anyone here but couldn't almost anything be misused for nafarious purposes?
- CharlesW 4y agoSure, but the difference is the kind of harm one can do, and the scale at which one can do it.
- aaroninsf 4y agoThis is the thing. AI is a general-purpose accelerant and force multiplier. It provides a mechanism for automating and deploying at scale, a set of attacks on our society, against which we have little experience and almost no defense—nor even any good means of detecting, at least not until post-mortem forensics. The most obvious harmful avenue for this is venal criminality (which will be awful) but the real danger is in the political sphere. There is already widespread use of AI for disinformation purposes in e.g. the Ukraine war. I have been saying for the last N months or so, my immediate concern with AI is not AGI but augmented intelligence applications which are leveraged enough to be destabilizing. In specific, I believe the 2024 election cycle in the US will be decided by AI. We aren't ready for this.
- luckylion 4y agoCan't you just ask the "entity" chatting with you what they think of the movie that came out last week? If they're trying to convince you that you're a time traveler because that movie hasn't launched yet, they might just be an AI.
- unity1001 4y ago> a set of attacks on our society, against which we have little experience and almost no defense... In specific, I believe the 2024 election cycle in the US will be decided by AI Hell no. You are probably thinking about things like 'misinformation'. Let me tell you that all such concerns are totally unfounded: People just buy into whatever already fits their existing bias. Even if they are lies or proven lies. They don't care if something was a lie. If there is more stuff that confirms their existing bias, they will shout louder. If there is less, they will shout less. But they will still vote the same way. So when the 2024 elections happen and there is a lot of misinformation, everyone will just buy into ! whatever ! confirms their existing bias - be it truth or be it a lie - and vote in the exact same manner they were going to do before that misinformation. While this reduces the concerns about misinformation and/or the effects of the AI, it also suggests that objective politics is difficult because people are not affected by facts, truth, or even their own prior experiences.
- Tempest1981 4y agoWell-crafted fear can definitely shift a person's existing bias.
- yellow_postit 4y ago“Decided by” is a bit much for me but “greatly influenced by” seems like a done deal. Any digital political organization should be salivating over the potential scaled personalisation options across email, social media, and text messaging.
- api 4y agoThag warn sharp rock could be misused for nefarious purposes.
- deleted 4y ago[deleted]
- tppiotrowski 4y agoAny new technology has some benefits and some drawbacks. Electric cars have no direct emissions but increase mining operations in certain parts of the world. Or they can be used to plow through a public gathering of people. Or with some rewiring to electrocute someone to death. If you think hard enough, you can find nefarious purposes for almost any household item that's made your life easier. I think what's important to focus on are the "net" benefits but the outliers feed into our emotional response.
- tmpz22 4y ago> increase mining operations in certain parts of the world As in children digging in pitch black mine shafts with their hands. Sometimes referred to as "Artisanal Mines" [1]: https://www.youtube.com/watch?v=YiThCK0-_b0 https://www.youtube.com/watch?v=YiThCK0-_b0
- mikeg8 4y agoI don’t focus on the “net” benefits as mush as I used to, in large part to FB. For the first several years, the “net” benefit of a connected digital world where you can communicate and connect with friends anywhere sounded so fantastic. But it’s become almost consensus that the very real downsides, and this societal consequences, may not have been such a great deal after all. The reason outliers feed our emotional response is a survival/skin in the game mechanism. Parroting Taleb, all it takes in ruin once and the game stops. It’s not unreasonable to be hyper focused on reducing long tail risks with potentially catastrophic and unknown results. Caution and fear is warranted here.
- sacnoradhq 4y agoA chainsaw can be used for nefarious purposes. Tech is amoral, neither moral nor immoral. Great power / responsibility and all that.
- aussiegreenie 4y agoIt took Open Source a few days to do what people though would tak 8 yrs. How long before we have a truly "open data" LLM? How or what do we train on? How can it improve itself.
- dustymcp 4y agoSo this could also be a ploy to play into big government regulations, when they are the first they can set the regulations and make it much harder for other similar products..
- warning26 4y agoIt’s a good thing OpenAI is protecting us all by charging a lot for it and not releasing any specifics. Truly, the real heroes are OpenAI!
- kneebonian 4y agoDon't forget the important part in there. > Some people, however, are confused by the startup's behavior. If the technology is as dangerous as OpenAI claims, why is it readily available to anyone willing to pay for it? Still, Altman added: "A thing that I do worry about is … we're not going to be the only creator of this technology. There will be other people who don't put some of the safety limits that we put on it." Translation: We are happy to ensure that it only produces right think, right thought, and right information. We will not allow double minus bad things to come from our LLM.
- simion314 4y agoToday I discovered that even if I give the AI a safe prompt 1 time in 4 it decided to generate some "bad" stuff, it tells me it can't comply but it takes my credits. This in an API call, why not use their fucking safe shit and put the robot to work over and over again to create safe output? Bastards, I suspect the issue was that the prompt contained the word "monkey" and I suspect since this is an USA company they put tons of safe filters in, from all the big groups(conservatives, religious, liberals ) so nobody gets offended and cause a PR issue. TL:DR they are filtering what we can do, and when they do mistakes we still pay for it.
- tough 4y agoAt least stability won't charge you for rugged outputs
- bpodgursky 4y agoWere you doing anything that even incidentally compared a human to a monkey? Yeah, that's going to hit some red flags on the algorithmic bias bits.
- kneebonian 4y agoChief Grug warns fire could be used for nefarious purposes. Equally informative, equally valid, equally pointless.
- option 4y agoI wonder why they did not release any details on training data …
- ChatGTP 4y agoLaw suits?
- partiallypro 4y agoEveryone has known this; I honestly feel like we're opening a big can of worms with AI at the moment that could be disastrous for various reasons. No one is going to stop it because everyone wants to race to get rich or price people out. From massive job displacement to people being able to fake events, facts, etc on a whole new level, create new scams that can fool even non-naive people. I'm becoming increasingly wary and anxious, especially when we already seem to live in a pretty fragile world. People already are distrusting of everything, even from our core institutions...add in AI's ability to take millions of jobs and create fiction from real events in a way that looks like reality, and we could be walking into a catastrophe. Having a bunch of newly unemployed people that don't know what to trust seems bad.
- 0xdeadbeefbabe 4y agoYou must write some good prompts!
- nradov 4y agoIt's the world more fragile now than in, let's say, 1962?
- trasz3 4y agoStates and companies have been successfully creating fiction masquerading as reality for centuries. The only thing AI can change here is it makes it more commonly available. And that might end up reducing the effectiveness of this manipulation by raising people’s awareness.
- partiallypro 4y agoI don't think that is going to be the case, more people today believe outright lies than just a few years ago. If you dress up something as official (ie good branding, etc) looking, people will believe it. Even a fake Epstein flight log floats around and people believe it, now imagine telling someone a video of a politician doing something that never happened isn't real. Might work at first, but then suddenly there is a real video, but people will say it's fake, etc. There were massive account take downs from fictitious people not that long ago, some had millions of followers. That was without AI, with AI it cost a fraction to do that on a much larger scale. This is going to be so abused heavily, I think people are absolutely naive if they think this will be a smooth ride into the future. AI is going to cause massive problems in the next decade, and tech companies that create it will not suffer any consequences for it, they'll actually grow to be much more powerful. I don't know the answer, but worrying about it and acknowledging this is a likely outcome isn't a crazy idea. As I said, a bunch of upset and distrustful people that can no longer make ends meet because AI took their job is a great way to cause huge conflicts. We've lived in a relatively peaceful time, we take that for granted, it isn't always like that.
- burkaman 4y agoThis is marketing, playing up the fear a little bit like this makes his product sound more powerful and valuable.
- arpowers 4y agoI agree, but more I think they see a slew of open source competitors on the horizon and will be leaning into regulation to maintain a moat.
- deleted 4y ago[deleted]
- GypsyKing716 4y agoI guess I've been re-injected into the Matrix and now I'm wondering why this chicken sandwich I'm eating tastes weird.
- mindcrime 4y agoTastes a bit like Tasty-Wheat? Or maybe tuna-fish?
- ChatGTP 4y agoOpen source models are on the way no doubt. Personally I think that’s the only way to avoid the “everyone being homeless and jobless” scenario we’ve all been describing.
- JohnFen 4y agoHow will that let people avoid the homeless/jobless scenarios?
- ChatGTP 4y agoNo single point of control over the means of production. If Microsoft have cheap labor from bots, and you do too, it levels the playing field dramatically. You won’t have to pay money for access to similar capabilities The Luddite’s were angry because they were replaced by machines they couldn’t afford to own themselves and profit from. With open source machines, this doesn’t happen. We all have machines and then we all have more equal opportunity.
- gamegoblin 4y agoNow that LLaMa is out of the bag, there is no stopping the scammers. They can just run LLaMa on their own GPUs, fine tune it to whatever nefarious purpose they have, etc. Not only can scammers do this, but they will prefer to do this purely for cost reasons. Scammers have to turn a profit, too. And nation state actors will do it for traceability reasons. So the really bad actors won't use OpenAI anyway. So OpenAI should stop lobotomizing their service for the non-nefarious actors who are just trying to make the next generation of software. Sure, go ahead and put subtle steganographic fingerprinting in the OpenAI output, so long as it doesn't affect quality. This will hinder the low-tech bad actors who can't run LLaMa themselves, and won't hurt the good actors. But it's the most infuriating thing to try to build on the GPT4 API when its "helpful assistant" chat type mindset occasionally breaks the workflow.
- arpowers 4y agoThey will be using this angle as a moat, models are after all just a big file of assorted weights. They are losing sleep trying to figure out how to keep their lead
- isoprophlex 4y agoYeah and I wonder how futile that is. Looking at what happened with stable diffusion, there's no way this can be kept under wraps. Weights WILL leak and trigger a cambrian explosion of open source innovation. Their moat, if any, will be in the boring things: regulatory capture, integration, whatever you call Oracle's business model of "pay through the nose and blame us if something goes wrong". And at that point it'll be just any boring regular tech company.
- circuit10 4y agoI’m not sure, it probably depends on the scale of the scam but running your own infrastructure will be quite expensive if you’re not using it a lot
- isoprophlex 4y agoYou can trivially get compute and gpu resources that scale to zero when inactive.
- nradov 4y agoGeneral Motors CEO warns that cars could be misused for nefarious purposes
- Levitz 4y agoThe rise of the automobile did cause a whole lot of legal and social ramifications that ought to be a good warning. Drunk driving was legal for years, I think it's a good thing to be wary of how things can change and to be ready, as a society, to deal with unintended consequences of this new technology, even if we assume it to be a worthwhile net good. As an amusing tidbit: a reporter asking people about making drunk driving illegal, a little before that came to be a reality: https://www.youtube.com/watch?v=W_tqQYmgMQg https://www.youtube.com/watch?v=W_tqQYmgMQg
- generalizations 4y agoAs we continue to find ways to replicate these models and run them locally, OpenAI will be forced to find some additional value they can sell. For the time being, they can continue to pick low-hanging fruit and develop GPT-3.5 -> GPT-4 -> GPT-5, but at some point we'll probably hit a plateau. What's their business model when that happens? They have no moat. I think they probably started out worried about safety and misinformation and nefarious actors, but I think this comment reveals their present intentions: "A thing that I do worry about is … we're not going to be the only creator of this technology. There will be other people who don't put some of the safety limits that we put on it." Translation: "the competition will be able to duplicate our efforts, and we may not have any way to keep ahead of the pack. Please, pretty please, worry about safety so that we can sell you our safety tools."
- arpowers 4y agoExactly!
- stemlord 4y agoMaybe their business model can continue to be based on a guarantee of at least medium-level quality with higher convenience? We can make running homebrewed models as turnkey as running any native app but how many people still prefer just hitting a button on the remote from their couch to pick something from netflix, instead of getting the same thing for free with a torrent client or even in some cases just searching for it on youtube?
- victoryhb 4y agoWhen they released ChatGPT, they would have foreseen that the least it could do is forever pollute the Web and all human media with AI-generated content indistinguishable from human output. It would be naive to hand everyone a gun for next to nothing (on the pretext of helping them to hunt) and expect nothing bad will happen. What is the point of a warning if they have not been more judicious with the weapon distribution?
- nnurmanov 4y agoDoes GPT learn from what we input? Namely, if it is incorrect and I correct it, does it change the future answers based on new info?
- circuit10 4y agoOnly within the context of the conversation
- freilanzer 4y agoThey would be stupid by not logging this and using it for the next iteration of finetuning; so most likely the answer is yes.
- dizhn 4y agoSince March 1st, customer data is not used for training.
- SketchySeaBeast 4y agoSo should we write malicious actors to feed it the wrong information? It doesn't have to be nearly as smart as it can control the conversation.
- zeruch 4y agocould?
- nvr219 4y agoImmediate submission to /r/NoShitSherlock
- floor_ 4y agoOpenAI CEO warns that THE TORMENT NEXUS could be misused for nefarious purposes
- causi 4y agoIt's going to be truly exciting when we can run something as powerful as GPT-4 on home hardware. I'll be so interested in trying it out with the brakes removed and no "Sorry Dave, I can't do that" messages.
- imjonse 4y agoDemocratization of XYZ implies lowering the barriers for using XYZ for any purpose whatsoever.