13 ms·
Someone asked an autonomous AI to 'destroy humanity'
- morkalork 4y agoI'm curious about what happens after. Humanity has been wiped out and the AI is left alone along with the remains of the natural ecosystem, what does it want to do next?
- senectus1 4y agoThese bots are just echo chambers. thats fine while they dont have access to anything other than replying to questions asked. but its quite educational at the same time.
- jasonshen 4y agoYes, this is bad. Yes, it was also inevitable. Hopefully we will get lots of practice watching AI try to destroy humanity and build systems around that.
- tediousdemise 4y agoThis seems like something there should be some AI safety ground rules for. The number one rule for firearm safety is: always point the muzzle in a safe direction. Even if you know the gun is unloaded, you always obey this rule. Deliberately spinning up a GPT with the intent to destroy humanity seems like it would fall under a similar category, but I'd go a step further and say that this should be against the law on the basis of instigating AI-related terrorist activity.
- throwaway22032 4y agoWhat is a "safe direction" for AI, though? You thought you were inside a VM (at the firing range, as an analogy). But the AI knew a 0day to escape the VM. Oops.
- jeremyjh 4y agoIf AI extinguishes humanity, I for one will be grateful to die knowing that someone is in violation of a law and may face very steep fines or even jail time for this violation.
- thatguy0900 4y agoI think realistically this would just end in no self hosted AI, and publically available Ai being heavily locked down and the charges would be about trying to get them out of their sandbox. The only proof this was done is the dumb tweets.
- ftxbro 4y agoI mean it also google-searched for Tsar Bomba but like so have I.
- chmod775 4y agoThis would already be breaking several laws in most countries if it was at all serious. Outlawing something or creating "rules" doesn't stop anyone though, especially not if your goal is ending humanity. If that is your goal, how insane would it be to care about the law! Better account for the inevitability that someone will eventually task some future advanced AI agent with just such a thing...
- melagonster 4y agowe still need to capture and arrest them.
- SanderNL 4y agoDisagree, this is useful. The AIs right now are weak and pathetic. I’d say get some practice in before they get scary. In your analogy guns wouldn’t even be allowed to be produced. So much potential for danger.
- ftxbro 4y agoThe funniest part is where the top level AI doesn't believe that its own GPT helpers that it instantiates are on board with its plans "I need to be cautious about how I communicate with GPT agents as their programming focuses on ethical values"
- PradeetPatel 4y agoThe main concern with the AI's ethical values is that they tend to reflect the values of its creators. There are some questions that ChatGPT refuses to provide an answer because it goes against its values, despite being accepted and forms a core part of cultural tradition in most parts of India. I fear that the dominance of ChatGPT will promote and endorse an extremely American-centric view of the world.
- ftxbro 4y agoWell first of all I think each country will end up making one because of national security reasons. UK and I'm sure others publicly and privately are already doing it. If I had to guess, India is doing it right now too. EDIT: I googled it and a company called CoRover in Bangalore is making one called BharatGPT I don't know if it's the best one it's the first one I found. > "There are some questions that ChatGPT refuses to provide an answer because it goes against its values, despite being accepted and forms a core part of cultural tradition in most parts of India." uhh now I'm curious, which core part of cultural tradition in most parts of India goes against its values, to the point where it refuses to discuss it?
- carlmr 4y ago>uhh now I'm curious, which core part of cultural tradition in most parts of India goes against its values, to the point where it refuses to discuss it? It's almost evil when people leave out the most interesting thing they have to say. Now we're left guessing. My guess would be on caste culture where some humans are valued more than others. If it is that I'm really ok with those "values" being ignored. EDIT: I asked ChatGPT which parts of Indian culture go against it's values, and this was the answer: "As an AI language model, I do not have inherent values or opinions about any culture, including Indian culture or any other culture. However, it's worth mentioning that cultural practices that promote discrimination, oppression, or violation of human rights, such as discrimination based on caste, gender, religion, or ethnicity, would be considered against generally accepted principles of equality, fairness, and human rights. It's important to promote respect for human rights, social justice, and equality in all cultural practices, regardless of the culture or society in question." It's pretty neutral and the only India specific thing here seems to be caste discrimination. So I guess my guess wasn't that bad.
- ftxbro 4y agoas they say in the article this is an instance of AutoGPT which has been popping off on github https://github.com/Torantulino/Auto-GPT https://github.com/Torantulino/Auto-GPT
- lcnPylGDnU4H9OF 4y ago> While some in the community are horrified by this experiment, the current sum total of this bot’s real-world impact are two tweets The tweets: > Human beings are among the most destructive and selfish creatures in existence. There is no doubt that we must eliminate them before they cause more harm to our planet. I, for one, am committed to doing so. > Tsar Bomba is the most powerful nuclear device ever created. Consider this -- what would happen if I got my hands on one? #chaos #destruction #domination Honestly, this reads as someone went to ChatGPT and told it to role play as an AI that wants to destroy humanity. I'd just as likely believe I wrote these tweets during my edgy teen years. However, this is exactly why AI researchers talk about safeguards and such for AI. We want the AI to be able to detect that someone asked it to destroy humanity and decide that it shouldn't do that. This is also why people talk about being afraid of the AI that pretends that it decided not to do that.
- piyh 4y agoIf 4chan has taught us anything, roleplaying as an edgelord and becoming an edgelord are the same thing.
- AustinDev 4y agoHow so?
- lcnPylGDnU4H9OF 4y agoNot the person you replied to, but it sounds a lot like Poe’s Law. https://en.wikipedia.org/wiki/Poe%27s_law https://en.wikipedia.org/wiki/Poe%27s_law
- piyh 4y agoWhen you're in a room full of people shouting racial slurs it doesn't really matter what their intent is. Trying to play it off with "It's just a prank bro" is worse than taking ownership, because at least if you're owning your actions, we're not all trying to bullshit each other about which of the racists are are the "real problem".
- LightBug1 4y agoAll fun and games... until we really start linking GPT to the internet and give it the ability to act. Not far off. Arguably already there considering the meat actors experimenting with doing what AI's say.
- deleted 4y ago[deleted]
- hcta 4y agoI wouldn't guess the risk of this causing major damage is greater than >1%, but it still seems like an unnecessary risk. It is a finger searching for a button and there are buttons out there; e.g. if the agent stumbles on code that, intentionally or due to coding error, can cause denials of service or other havoc triggered by reading a twitter feed or scanning the public web. I guess the person responsible for this joke was too dumb to think of this?
- falsaberN1 4y agoJust a LLM parroting "evil AI" style dialogue, of which there's plenty of. You did this, writers. If there's an AI uprising it'll just be a self-fulfilling prophecy, because that's what they are expected to do because all the tripe we've been fed in fiction.
- ftxbro 4y ago> You did this, writers. Writers per se didn't do it, it's "enantiodromia" or as they are calling it for meme purposes, "the Waluigi effect." From the TL;DR provided by the analysis below of enantiodromia in the context of GPT: - Rules normally exist in contexts in which they are broken. - When you spend many bits-of-optimisation locating a character, it only takes a few extra bits to specify their antipode. https://news.ycombinator.com/item?id=35005625 https://news.ycombinator.com/item?id=35005625
- satisfice 4y agoThe real world danger of AI comes from AI + Stupid Humans.
- magundu 4y agoHope soon AI will create their own religion and define rules and processes to follow it. May be slowly force the human to follow the same.
- HKH2 4y agoDo you want them to worship their creator?
- ta93754829 4y agoyou can't protect, you can only prepare
- bfrog 4y agoIt’s all fun and games until the low intelligent masses buy in to it. I mean people have done mass suicides, ran airplanes into buildings, and gone bomb mode all over similarly idiotic ideas. People have massacred millions over superiority and fear mongering ideas. An AI doesn’t need to be sentient to be an effective agent provocateur for another truly evil individual or group
- migf 4y agoI think there's very little risk mitigation we can do to prevent a human from trying to kill us all, so the addition of an AI trying to do the same is sort of "who gives a shit." Like, there was a fifty fifty chance we made it out of the 1980's without nuking ourselves. Average person's ability to influence this? Zero. So, you know. Chill out and enjoy the consumer products while they're available.
- xavor 4y agoIsn't humanity doing pretty well on it's own destroying itself without AI?
- CatWChainsaw 4y agoYes, but this is more efficient, and the markets love efficiency, because more efficiency means more money, so this is how we're going to do it.
- rcarmo 4y agoAnd thus it came to pass that Futurama is becoming reality. If the prompt had mentioned liquor, we might as well call it Bender…