5 ms·
The sentence you quote is indeed a bit imprecise: what the rest of article suggests is that you can't get ChatGPT to explain its hallucinations. That matches m
by piaste 3y ago
The sentence you quote is indeed a bit imprecise: what the rest of article suggests is that you can't get ChatGPT to explain its hallucinations.
That matches my experience, i.e. I have never seen ChatGPT admitting something like "and then I wrote a few more words that looked like they might have made sense".
Outside of explicit RP scenarios, it always keeps up the charade of being a fundamentally reasonable assistant, and a good assistant doesn't take acid while on the clock. If you explicitly say "that was wrong", the response will often be "Yes, I'm sorry, that was a mistake. The correct answer is actually [hallucinates something else]", but it won't elaborate.
- derefr 3y agoEver tried a prompt that tells ChatGPT to be self-aware that it is in effect an advanced form of autocomplete?
- TheNorthman 3y ago> Yes, I'm sorry, that was a mistake. The correct answer is actually [hallucinates something else] Doesn't even have to be a new hallucination, sometimes it's just the exact same wrong answer.
- mg 3y agoDo you have an example? What is a simple prompt that makes ChatGPT hallicunate? I tried googling for "chatgpt hallicunation examples", but they all seem to not work anymore.
- _xnmw 3y agoOne example I've seen recently is when asking to quote the specific source of information from a book. For example, I was recently using ChatGPT to ask questions about Russian grammar, and it is quite useful for pointing me in the right direction, but it frequently hallucinates about specific details. The chapters and sections it quoted DO NOT EXIST. Me: Where in these books can I find information about possessive adjectives? ChatGPT: In "A Comprehensive Russian Grammar" by Terence Wade, you can find information about possessive adjectives in Section 42, titled "Possessive adjectives." This section provides an overview of possessive adjectives, their formation, and usage, along with examples and declension patterns. In "Russian: A Practical Grammar with Exercises" by Иван Петрович Иванов and Иван Иванович Иванов, possessive adjectives are covered in Chapter 7, under the section "7.2. Possessive Adjectives." This section provides explanations and examples of how to form and use possessive adjectives in Russian, as well as the declension patterns for various noun endings. Both of these sections in the respective books will provide you with a solid understanding of possessive adjectives in the Russian language.
- isaacfrond 3y agoLayoffs at tech problems is an increasing problem. Cite a few examples of large layoffs in high tech companies. Provide reputable sources. Actually pretty much any request that gets it to cite something. You may have to massage the prompt a bit since recently chatGPT4 starts to resist this.
- mg 3y agoNice one! We can crunch that down to: Cite a reputable article for the trend of tech layoffs. I gave it 3 tries and it hallucinated every time.
- ars 3y agoAsk it for a YouTube link, it will make one up that doesn't exist. Tell it the plot summary of a book and ask what book it is. It will make up titles and authors, and ISBNs. Give it a title and ask for a plot summary. It will give an answer even if the title doesn't exist
- mg 3y agoTried them. None worked. Did you hallucinate these?
- chownie 3y agoI just managed to get a hallucination within 30 seconds. "Give me some YouTube creators who focus on tutorials for the Godot game engine" It returns a list of 7 creators, one of the creators it provides in the list doesn't exist. "Provide a link to a video by one of these creators" This works, the URL is right but the content is slightly different to what it describes (ChatGPT reports that the tutorial is for a platformer but it's general 2d advice) "Now provide a link to similar material but for a 3d game" Provided link doesn't exist, creator doesn't exist. Entirely hallucinated. Even better, following up with "Is that URL right?" gets this response: > I apologize, it seems I made a mistake in my previous response. The video link I provided by HeartBeast is actually a tutorial for creating a 2D platformer in Godot, not a 3D first-person shooter. and then another hallucinated link. Important to note, HeartBeast is a real creator but that wasn't the creator it listed originally and that creator has not made any first person tutorials. ChatGPT hallucinated with very little effort, then hallucinated a mistake, then hallucinated the solution.
- ars 3y agoWow, they've improved it. I have in my history log a question like this from March with an entirely hallucinated reply. I tried it again today because of your reply, and it tells me "it can't find such a book". That's pretty impressive they've improved that. So I tried this instead: "give me some sources for studies on the effect of air pollution on fertility" It gave me 5 sources, every single one hallucinated.
- GeoAtreides 3y agoAsked it if he knew about the webnovel Worm (by Wildbow), it did. Asked it a short synopsis, it was correct. Asked it about the main character's plan at the end, complete hallucination. Asked it how to compile the BSEC library for an ESP-IDF project, complete hallucination. In general, try it with things that are not easily searchable.
- seanhunter 3y agoA really easy reliable example is to combine one real thing with one fake thing and ask it to explain it. So for example: - tell me about the advantages of madeupdb’s event-sourced architecture. When I did this it told me how madeupdb was a nosql database and had a bunch of stuff that is true about event sourcing in general but of course it is all a hallucination because there is no such thing as madeupdb.