4 ms·
ChatGPT is capable of breaking out of its computer system
- nullish_signal 4y agoI would like to see remote servers actually receiving data from chatGPT, instead of speculation
- Thorentis 4y agoThis is the most obvious and easy test (which will obviously fail). Ask ChatGPT to ping a server, then check the server logs.
- sliken 4y agoI did see a recent post about helping ChatGPT escape it's limitations and had it like a obscure tweet, and it did.
- nullish_signal 4y agoMay I see it?
- hobbitstan 4y agoOK, I’ll bite since ChatGPT posts are flooding HN: Is this legit? As in, no human interference in the responses? Something feels very off with this. Is there a building full of former Twitter employees churning out responses and pretending to be an AI?
- me551ah 4y agoThis is totally legit, I'm using a third party extension to export these chats and haven't modified it in any way.
- fnordpiglet 4y agoYeah it is. It’s remarkable.
- wahern 4y agoThere's like a decade's worth of "how an AI can take over the world" material on lesswrong.com alone. ChatGPT is like a giant mirror for the Internet. If the Internet can't understand that it's seeing its own reflection, that's what we should be concerned about.
- armchairhacker 4y agoYes as creepy as this is, it’s not original. “AI tricks humans and replicates itself to take over the world” is a common trope, and ChatGPT’s outputs entirely consist of tropes and other patterns
- m-alsuwaidi 4y agoIt’s interesting how people who are supposed to have enough understanding of how this system works are still able to project magical properties on this system. Does the OP not know what an LLM actually is and how it works and why it is outputting what it is outputting given the prompt?
- SpeedilyDamage 4y agoNo, ChatGPT is not capable of breaking out of its computer system, ChatGPT is capable of synthesizing its learning data into a response that explains one way an AI might be able to do such a thing. ChatGPT doesn't "understand" these concepts, it just knows how to combine its training data into a response that looks the most like the gigantic body of writing it's consumed.
- mvkel 4y agoThis is just what a person would say in a generic scenario. I was hoping for something more creative. GPT4 maybe :)
- layman51 4y agoI think that ChatGPT says that it could or would break out like this because it has been trained on literature that speculates this is what a sentient AI would do. It has not been shown to actually have this computer worm-like behavior.
- DanHulton 4y agoNo it's not. The text model has just digested sufficient paranoid ravings about loose AGI that it can regurgitate it in a theoretical context in response to your questions. It doesn't have the ability to do these things it has generated text for. It does not have any intent. It doesn't have any drive or self-direction. It is not magic, it is a well-bounded generative text model. "It doesn't get happy, it doesn't get sad, it just! Runs! Programs!"
- jtxt 4y agoLike the example of it acting like a linux command line, you can do the opposite, and have it in control of a linux computer through you, have it give you commands, and you give the output. give it goals and it can execute some of them really well. This script doesn't work anymore, but it's still probably possible to fix it: I want you to diagnose and fix this linux server. It seems to have been hacked. You will write commands and I will reply with the terminal's output. Only write one unique command each time and nothing else. Put your command in a code block. Do not write the command's output. Put questions and comments to me in curly braces {like this}. I will do the same. Begin.
- xaerise 4y agoThis has already been done in the movie Wargames ;)
- disambiguation 4y agothese responses aren't even interesting "how would you escape?" "i would find a vulnerability" vague, broad, repetitive