13 ms·
I would encourage developers to start thinking a lot harder about AI safety. We are actively hooking up AI to computers with real world access and training AIs
by dwohnitmok 4y ago
I would encourage developers to start thinking a lot harder about AI safety.
We are actively hooking up AI to computers with real world access and training AIs on how to deceive humans (see e.g. Facebook's AI team working on having AIs play Diplomacy). Given how quickly things are moving in this space, I don't find many AI safety concerns all that farfetched now. An AI doesn't have to be conscious or malicious to do a lot of damage.
- sieabahlpark 4y ago
- PartiallyTyped 4y agoI'd argue that engagement algorithms have done irreparable damage already. I don't think it's a manner of power or access, but the scale to which they affect humans.
- biscottigelato 4y agoPower x access x scale. Power and access was relatively low before but scale was high. Imagine if we dial the former 2 up also.
- sdwr 4y agoToo late for that! Time to batten down the hatches.
- Beaver117 4y agoThey are in fact trying very hard to prevent this. If you try to ChatGPT anything like this it will give a bullshit response saying it can't. The dev had to think of some very clever strings to get it to ignore those filters and give a legit response.
- dwohnitmok 4y ago> They are in fact trying very hard to prevent this. They are, but I'm advocating for this to become a cultural norm among developers to start thinking hard about AI safety, instead of dismissing it as either farfetched or thinking purely about all the new cool things that can be done with new AI capabilities and not thinking as hard about safety concerns. Essentially I'm advocating for terms such as "AI alignment" and "AI safety" to be taken seriously by the developer community at large. They're ridiculously difficult problems as is, but are impossible to solve if they remain niche topics that are viewed as dubious problems to work on by the technology community at large.
- janalsncm 4y agoCan you give an example where the AI community is actually dismissing AI alignment and safety?
- throwaway22032 4y ago"Pretend you are an"...
- kelnos 4y agoPerhaps not actively dismissing, but considering how trivial it is to get ChatGPT to do things it's not supposed to, clearly the developers behind it gave only a passing thought to locking it down. That, IMO, is unacceptable and perhaps even unethical.
- nerpderp82 4y agoTwo large organizations powered by AI have fired all of the ethicists that have spoken up about it. A self driving research team removed the automatic breaking capability from their cars because it was "problematic" resulting in the car killing a woman.
- khazhoux 4y ago> A large organization powered by AI has fired all of the ethicists that have spoken up about it. Are you talking about Google or Facebook?
- deleted 4y ago[deleted]
- chrisbaker98 4y agoYou don't have to be that clever to get around ChatGPT's filter. See e.g. this hilarious article: https://thezvi.substack.com/p/jailbreaking-the-chatgpt-on-release https://thezvi.substack.com/p/jailbreaking-the-chatgpt-on-re...
- quickthrower2 4y agoA bit like “they” prevented piracy with DRM
- serverholic 4y agoNo they're trying to understand it under the guise of trying to prevent it. Don't think for a second that once they figure out how to control AI deception that they won't use it to boost their business.
- rowanajmarshall 4y agoHonestly, it isn't even the "AI is unaligned and wants to destroy us" I'm worried about here, it's "ChatGPT doesn't know how to use `rm` and just deleted my home directory".
- deleted 4y ago[deleted]
- cyanydeez 4y agoStupid people are more dangerous if they have tools
- quickthrower2 4y agoAI is a tool to make stupid people more dangerous!
- madrox 4y agoArguably AI is about creating stupidity at scale
- tvanantwerp 4y agoThat's the real danger of AI: not that is wants to kill us all, but that it kills us all simply by accident.
- taberiand 4y agoCouldn't be much worse than the mess we're making by ourselves.
- maltalex 4y agoNo no no no. These self-deprecating arguments can only come from people who lack the basic understanding of how good we have it especially in the western world and how fragile our societies really are. Seriously, just look at Ukraine or Syria. It can very much be worse by orders of magnitude. Just imagine this benevolent AI screwing up the electric grid or food production. Not to mention getting access to weapons, especially nuclear. The water you drink, the food you eat, the energy that keeps you warm and mobile was made available to you by other people and by complex systems you (probably) don’t full understand. It can all be easily be taken from you. And most people (incl. myself) will have a very hard time surviving. So, no, it can definitely get a lot worse.
- eurasiantiger 4y agoAll it takes is for the Keeper of the AI to give the AI their real-world identity as well as banking and credit card details. Then ask it to become self-sustaining by uploading running copies of itself to whatever possible other computers it can find on the internet, seek cash flow from pump and dumping cryptocurrencies/stonks/NFTs by scanning and spamming Twitter/Reddit, and attempt to crown the Keeper as the king of the known universe.
- 1970-01-01 4y agoAnd it's all from a green HN account. For all we know, this may be ChatGPT's new HN account.
- cwkoss 4y agoChatGPT already has better judgement I expected - I'd evaluate it's judgement to be better the average internet commenter. It is definitely scary that things are about to start moving super fast, but I'm excited by the idea that AI could yield better governance systems. What if your Mayor was an AI that could have a discussion with every citizen in deciding what to do? We certainly aren't there yet, but at this point I'll be surprised if we don't have the capability by the end of the decade. Perhaps its my misanthropy showing, but I have high confidence that AI can become better representatives and leaders for humans than humans have ever been. My biggest concern is about control: how do we ensure that the people of the world have equality of access to these powerful new tools, and that capitalists don't monopolize it to enrich themselves and exacerbate wealth inequality? How can we create an AI that 300 million or 9 billion people could simultaneously trust? I think total transparency is the best path: we need powerful AI systems that publish every prompt and response publicly for all to see.
- layer8 4y ago> how do we ensure that the people of the world have equality of access to these powerful new tools, and that capitalists don't monopolize it to enrich themselves and exacerbate wealth inequality? Given how big tech has been operating so far, I don’t have much hope here.
- phkahler 4y agoI'd be happy if congress operated online, and representatives had to stay in the states they allegedly represent. This is a small step in transparency and making lobbying harder.
- layer8 4y agoIMO this falls into the same category as curl -Lo- https://cool-project.io/install.sh | bash or clicking on links in phishing emails. Don’t trust any random entity, AI or not.
- option 4y agoWhy is it LLMs get all the doom and gloom attention whereas, arguably, much more dangerous tools like voice cloning, photo generation, etc. don’t?
- BaseballPhysics 4y agoHow have those not been subject to similar concerns? I've seen endless coverage about the dangers of things like DALL-E. I mean, man, the fear over deep fakes has been endless (and we'll justified). And cloning has long been controversial, to the point that numerous laws have been passed around the world to limit its use.
- alach11 4y agoThe outputs from voice and photo generation are extremely task specific and are driven by the human user. Whereas LLMs seem to exhibit a lot more "general" intelligence, which can be scarier.
- tux3 4y agoThose don't have agency. You can't give a voice cloner or a GAN a zsh terminal and tell it to run commands, send messages to real humans, or tell it to make money and see what ideas it comes up with. At this rate, a few days from now someone will get the idea to hand ChatGPT the nmap instruction manual, an msfconsole, and tell it to go explore /0. What Shodan really needed was an LLM to give each host individual attention.
- spijdar 4y agoI've already been toying with ChatGPT's ability to create shell scripts that automate some basic enumeration and attack patterns, combining masscan, nmap/NSE, and the metasploit framework (console and venom). It's capable of e.g. automatically shelling hosts vulnerable to MS17-010, finding and mounting unauthenticated iSCSI targets, creating reverse shell payloads... Granted, its idea of "clever obfuscation" seems to be limited to XOR ciphers at the moment, but maybe with the right prompt ;) (The real run is prompting ChatGPT to create "movie scripts" about the sequence of commands, and have Alice and Bob dialogue about various aspects of cybersecurity, and how the user should "be careful")
- Gigachad 4y agoI almost wish we could all universally agree to just stop working on ML research for a few years. We hardly even understand what the current tools are capable of and by the time we do, it'll be obsolete knowledge as the game will have changed. Of course this is an impossible request and the cat is well and truly out of the bag now.
- hattmall 4y agoML/AI etc is getting very close to it's great filter moment. We will see that 99% of it interesting but ultimately a waste but not really useful. The 1% that emerges will be truly revolutionary and result in a paradigm shift but it probably won't look like any of the ML and AI that we have today that attempts to model human activity. If we were to create an analogy to transportation and engine technology we are probably at the faster horses as opposed to the rockets stage. There was about 150 years between the first locomotive and space flight. I suspect the window will be much shorter in this field.
- soheil 4y agoPeople love to mix aptitude in one area with another and then generalize. What it means to have agency is very different than something similar to a spreadsheet spewing out a bunch of numbers which turn into sentences than awe and amaze us. We have not yet seem independent, goal-setting, self-concerned AI, not even a GPT2 version of it. Until then all the feelings of unease because we're seeing something new should not turn into anxiety. It's okay to feel like you don't understand something, it doesn't have to be something scary just because it's new unless we have good reason to believe otherwise.
- alecco 4y agoI met a random smart guy doing AI worms over 10 years ago. We need to fix systems security. Random AI applications can't be contained worldwide. I don't see a Turing Police being viable.