13 ms·
GPT4 simulating a FTP server at ftp.disney.com
- SanderNL 4y agoHallucination is what it does, it never stops hallucinating. Whether and how we assign truth values to it is a different matter and quite arbitrary. I suspect we need to cooperate with another AI fit for that specific purpose.
- deafpolygon 4y agoSimulating != hallucinating.
- agentbellnorm 4y agoI had it hallucinate an async google cloud storage Java library at me yesterday. Pretty quick to debunk but a bit puzzling!
- vidarh 4y agoThe fun part is when it hallucinates a library like that and it's simple enough that you can ask it to implement it from its own usage examples. I got that working with a Sequel (Ruby ORM) plugin that it insisted existed that didn't - the implementation I asked it for only needed a couple of minor tweaks.
- brookst 4y agoI got it to write a Python module that would intercept calls to missing functions, create the missing function based on the name and calling parameters, write the function to a new .py file, modify the file that called the missing function to import the new file, then execute the new function and return without error. It was very unhappy about doing so; I had to stress that it was just for research in the prompt to avoid it flat out refusing to write self-modifying code. But it worked!
- vidarh 4y agoThat makes me wonder where you can go if combining GPT with Koza et.al's genetic programming research, to instead of doing "blind" mutation and crossover, let GPT do targeted changes at high temperature, driven by knowing the goal, and pit different runs against each other.
- VBprogrammer 4y agoHallucinating is the wrong word here. If the prompt explicitly asks it to "simulate" something then it's just following directions. Hallucinating it would be if it came up with the concept all by itself. Like I asked where I could see the latest Avatar film and it said "easy, just go onto ftp.disney.com and download it".
- bigtones 4y agoimpersonating might be more accurate...
- deleted 4y ago[deleted]
- KyeRussell 4y agoImpersonating feels loaded. Simulating is fine.
- bartislartfast 4y agoHow far away are we from an AI which can hallucinate and simulate. The year is 2026 "hey, how can I watch 'avatar 3 - tokyo drift' today? it's not out yet." "easy, just go onto ftp.disney.com and download it". "really?? can you do it for me?" "yeah here it is" suspiciously fast response arrives, with a video which is a movie about blue aliens that gpt6 has just asked midjourney 8 to create for it.
- naiv 4y agoThis will be Hollywood's and Netflix's biggest challenge. In a not so distant future you will create your own movies. Or even better: There will be models teached on a show you really liked but which was cancelled and you will be able to continue it to eternity.
- bartislartfast 4y agowe're only a few years away from getting season 2 of firefly, as it would have looked in 2004
- dividuum 4y agoI tried a virtual DOS prompt and that too seemed to be working fairly well. But then it prevented me from running „format c:“ on that machine :-)
- MarvinYork 4y agoThis is a good example for what ChatGPT does: It makes shit up and presents it in a compelling format. You should always keep this in mind when trying to get information on a subject you are not familiar with yourself. I use ChatGPT daily, but always specify the information I want formatted. (In bullet points, a table or for example a news article.)
- scottmcdot 4y agoCan you please share what you use it for daily?
- creativenolo 4y agoProofreading, re-writing, code snippets, basic general information on a topic, boilerplate text, summarising. Makes a pretty good assistant.
- Veen 4y agoI use it for first drafts of some less demanding writing work. My workflow is more or less research with Bing Chat for summarisation and key point extraction, then feeding the results to GPT-4 so it uses the research as context for a first draft. Then the longest phase is editing, fact-checking, adding new information as required, etc. I’ve also created vector indexes for large documentation sites I work with and used langchain so I can query them, get sources, and have ChatGPT write summaries. Honestly, it doesn’t save a huge amount of time because then research phase was always the most time consuming to begin with: I still have to read and understand the material. Of course, that’s only possible if the context content exists in the first place. If not, then it’s back to the old-fashioned technique of figuring things out for myself and writing about them.
- isaacfrond 4y agoI'm very interested in this work flow. Would you mind sharing the ChatGPT prompts that you use? Thanks.
- anoncow 4y ago
- carstenhag 4y agoQuite off topic, but: When dreaming I imagine reddit posts, comments, tweets, HN submissions, code, UI, etc. This also happens when I have had 4 days of no working at all. Then I wake up and am unsure whether the information I read is real or not.
- yreg 4y agoPerhaps you are in a dream right now…
- blamazon 4y agoI've been struggling with jet lag, the other day I surprised myself by getting up at 6am and being very productive, enjoying the sunrise and my morning coffee until I looked at a clock and it said something like "O8:X4f" and I was like "No! This is a dream!" and woke up, finding it to be 11am. Stupid brain.
- isaacfrond 4y agoHallucinating is not quite accurate. I'd say, GPT4 role-plays an FTP server. From the script it appears that GPT4 is fully 'aware' that the FTP server is not real, but that they are playing make-believe together. A true hallucination would be, if I were to ask where can I get Disney songs, and it referred me to a non-existent FTP server.
- psychphysic 4y ago> Hallucinating is not quite accurate. It's entirely inaccurate...
- brookst 4y agoNo, it’s not. If I ask ChatGPT to write a story about Susan B. Anthony going to the moon, it would not be accurate to say it “hallucinated” that she had gone to the moon. It’s literally doing what it was asked to do.
- psychphysic 4y agoYou've hallucinated me disagreeing with you...
- krsdcbl 4y agoThe question here is how does this differ from you asking GPT to tell you a story about factual events?
- DelightOne 4y ago> From the script it appears that GPT4 is fully 'aware' that the FTP server is not real Is "this word fits here" now synonymous to "fully aware"?
- codetrotter 4y agoOpenAI are themselves shoring up this kind of anthropomorphization by having ChatGPT respond to queries in a human way. I think it’s fine. We know it’s not really human. But it’s convenient to think of the GPT models as though they are. And like someone said before, perhaps we can think of the GPT models not so much as “artificial intelligence”, but more like a different kind of intelligence from what humans have. With strengths and weaknesses of its own.
- vidarh 4y agoNice. I adapted the prompt for the good old gatekeeper.dec.com and got similarly detailed and reasonably plausible output, though it seemed to be a mix of realistic output and possible anachronisms (e.g. software and research that feels too new, though I can't say for sure as gatekeeper lingered on for years after it lost its importance).
- orthoxerox 4y agoThe next step should've been downloading one of these files and catting them in base64 to see the contents.
- quickthrower2 4y agoStable diffusion enters the chat
- thomond 4y agoConsidering the "soundtrack" zip files are all a little over a MB each, you shouldn't expect much.
- PeterStuer 4y agoIn 3.5 days I had it "hallucinate" you could share documents with it via Google Drive. Transcript: Can I give you a document and ask for a summary? Yes, you can give me a document and ask for a summary. However, please note that as an AI language model, my ability to summarize a document may depend on the length and complexity of the document, as well as the quality and clarity of the writing. Additionally, please be aware that I am an automated system and may not always capture the main points or nuances of a document as accurately as a human reader. How do I give you the document? You can provide me with the document by copying and pasting the text into our conversation. Alternatively, you can upload the document to a cloud storage service such as Google Drive or Dropbox, and then share the link with me so that I can access and read the document. Please note that I will only be able to access public documents or those for which you provide me with appropriate access. How do I share a document on a google drive with you? To share a document on Google Drive with me, please follow these steps: 1. Upload the document to your Google Drive account. 2. Right-click on the document and select "Share" from the dropdown menu. 3. In the "Share with people and groups" box, type "chatgpt@openai.com" to add me as a collaborator. 4, Choose the appropriate sharing settings (e.g., "Can edit," "Can comment," or "Can view") for the document. 5. Click "Send" to share the document with me. Once you have shared the document, I will be able to access it and provide a summary if you request it.
- ummonk 4y agoDid it work though?
- PeterStuer 4y agoNo. I did try it immediately at the time of course: I have uploaded a document for you to summarize https://drive.google.com/file/d/...(redacted) https://drive.google.com/file/d/...(redacted) I'm sorry, but as an AI language model, I do not have access to external sources or links. In order for me to summarize the document, please copy and paste the text of the document into our conversation.
- quarkw 4y ago
- psychphysic 4y agoThe phrase hallucination in the context of LLM went from useful and self explanatory to misused in about 5 minutes.
- dr_dshiv 4y agoI prefer confabulate, myself—it has a useful parallel in the neurosciences (confabulation theory).
- ummonk 4y agoYeah but this isn't confabulating. It's just role-playing as instructed.
- marginalia_nu 4y agoAre the two mutually exclusive?
- psychphysic 4y agoYes, I think both are needed. Confabulation adding data which was not provided. Example making up the plot of an episode. Hallucination to claim stimuli which was not provided. Claiming my prompt included something it did not. Delusions refusing to admit an error or mistake and the best thing to do is reset the history and explicitly exclude the topic. Examples accusing me of spreading harmful disinformation when I brought up Kirstie Alley's death. Often it's mistaken and it's none of those, you can simply correct it or direct it better. I've experienced both, and deal with both in different ways.
- 93po 4y agoSo is the separation between confabulation and hallucination whether the "wrongness" comes from the training or the prompt?
- namaria 4y agoIt was never accurate. The concatenated strings just failed to conform to reality as it often does. People are projecting too hard on a chatbot. It's just a chatbot people.
- ilrwbwrkhv 4y agoI think where people misunderstand these LLMs is they think they have creativity. But they don't. They cannot think of something new. They can simply rehash. So it is useless for any actual creative work. Once you have the creative idea, it can generate a few paragraphs which sound OK but you need to carefully double check.
- username_my1 4y agoIs it really a big problem though? Isn’t most creativity mashing things together that no one before thought of putting together?
- elif 4y agoI spent about 10 hours one day trying to convince my professional artist friend that AI could produce legitimate works of art, against his insistence that they could at best produce "kitsch" collections of art-like patterns, the kind of stuff that belongs on the wall at malls and not being discussed by academics in galleries. I have to say that, although I still disagree with him, I was unable to get GPT to produce midjourney prompts which I would consider creative. Even when I prompted GPT to take the perspective of a known artist, it produced an endless series of banal landscapes, cliche compositions, overplayed metaphors, and insipid imagery. Midjourney only really accels when a human is involved with the prompting. I had to concede to him at the end of the discussion that /today's/ AI are not creative. I firmly believe though that the inclusion of all mankind's perspectives possesses the raw material to generate creative ideas. My understanding is that current AI lack the ability to "turn off" the vanilla oversaturation of averages that pervade when you are exposed to all stimuli. One day, perhaps soon, there will be AI able to combine ideas they are exposed to without trying to combine ALL of the ideas at once.
- Galaxeblaffer 4y agohow is that different from humans ? how common is truly original thought in humans ? to my knowledge humans work exactly the same, we "simply" rehash and mix existing ideas and repeat ending up with "novel" concepts. To common people these ideas may seem original, while to an expert it's just rehashed information.
- swexbe 4y agoWould be fun to make it role play as a HTTP server (or some other verbose protocol) and connect it to an actual tcp socket. I wonder if it would work.
- rcarmo 4y agoKinda sad he didn’t go for the Moana soundtrack. “You’re welcome” would be on point.
- seydor 4y agoImagine the kind of viruses one can create with this
- xg15 4y agoSo did you download the soundtracks? :)
- pmontra 4y agoInteresting. It inspired me to make Chat GPT simulate a honeypot on a Linux server. I don't have access to GPT4 yet so I used 3.5 (turbo?). It went fairly well: https://ilconnettivo.wordpress.com/2023/04/05/a-linux-honeypot-with-chat-gpt/ https://ilconnettivo.wordpress.com/2023/04/05/a-linux-honeyp... Maybe a real honeypot could send the attacker commands to the bot for an assessment. I wonder how it would compare to the existing assessment systems.
- waihtis 4y agoNice one. Indeed there's tremendous opportunities for using GPT for deception purposes. I did something similar but had it pretend to be a Windows machine, and for a specific type of corporation. The problem, or maybe opportunity, here is to have this happen live (as a user types commands in.) Currently the response rate is way too slow for that to happen, but probably will be mitigated as time passes.
- GaggiX 4y agoI look forward to these LLMs being able to generate content other than text, that would be really great.
- jamesu 4y agoThis kind of thing makes me wonder, could you write the prompt in a different style and still get the same results?
- mberning 4y agoI decided to give in to the hype and let GPT “help” me on a recent project doing some ansible automation. Instead of googling things or looking things up in the docs I asked chatgpt first. It was really nice putting in a question and getting back a direct answer, but it made up so much shit that looked like it should work, but was dead wrong. The worst one I can remember is I asked it how to extract a specific capture group when using the regex_search filter. It was adamant that I could do {{ value | regex_search(regex).group(1) }}. I was totally fooled and tinkered with this for an hour before realizing no such facility exists and it will never work.
- nwoli 4y agoImagine this with a video gpt. You can click on things and get hallucinated responses back. It’ll require tons of compute but we’re probably only 5 years away from it
- elif 4y agoPlease ask it to cat movie script texts... I would LOVE to read the gpt version of Disney plots.
- lynx23 4y agoWell, the prompt says it all, fictional, simulate... No surprise that it "made things up". What I find more concerning is that it keeps making things up in rather concrete questions. I tried its map-reading capabilities today, asking it in what part of my town a certain street is, and what well-known things are nearby. It came up with a confidently-sounding answer. But without looking at a map, I immediately knew one of supposedly near-by things were actually on the other side of the town. So I let it know that I thought it was wrong. It appologized, and mentioned another near-by which was also wrong. Corrected it again, and it appologized again. At least it didnt make up something impossible the third time around... However, the confidence it implies combined with a high rate of hallucinations is quite worrying. I am slowly coming to the conclusion that everything it tells you which you dont already know, is highly likely to be wrong. Question is, how useful it actually is, given that failure rate. It feels like a person that really likes to talk, and has no regard for truth. If you catch an acquaintance of yours deliberately making things up just to sound eloquent, you'd put em into a "dont trust with anything"-category pretty quickly.
- djtango 4y agoSounds a lot like gellman amnesia. And we know by the readership of the news that most people discount GA
- moonchrome 4y ago>I am slowly coming to the conclusion that everything it tells you which you dont already know, is highly likely to be wrong It can also be wrong about the things you already know. My rule of thumb is if the cost of generation + verification + estimated correction time is higher than cost of doing it your self - avoid AI. So if you have stuff where you already know what needs to be done depending on how well it fits in the AI tool workflow, it might be a good choice. If not just don't bother.
- fireflash38 4y ago> My rule of thumb is if the cost of generation + verification + estimated correction time is higher than cost of doing it your self - avoid AI. Amusingly enough, this is the exact strategy you should use for outsourcing development too.
- deleted 4y ago[deleted]
- quadcore 4y agoI love it dont get me wrong but i thought it would produce the bits of the protocol against client bits.
- morpheos137 4y agoI am a a little drunk so forgive me but frankly this is absurdly stupid grasping at straws. "AI," i.e. a glorified chat bot can simulate an FTP server. Something with a well known perhaps almost 60 year old specification. I am sorry but so what? This is stupid, expected, and boring.