3 ms·
> An example I can remember from the paper is "Who is Tom Cruise's mother? [Tom Cruise's mother's name]" paired with "Who is [Tom Cruise's mother's name]'s son?
by alphablended 3y ago
> An example I can remember from the paper is "Who is Tom Cruise's mother? [Tom Cruise's mother's name]" paired with "Who is [Tom Cruise's mother's name]'s son? [incorrect answer or "Can't answer that"]".
The paper is, apparently, still under review.
In the mean time, may I suggest you to verify that example by yourself?
- kybernetikos 3y agoI'm seeing exactly what lucubratory described with ChatGPT. If the information is in the context window, it has no trouble working out the reverse. Me: Who is tom cruises mother? ChatGPT: Tom Cruise's mother is Mary Lee Pfeiffer. User: Who is Mary Lee pfeiffers son ChatGPT: Mary Lee Pfeiffer's son is the famous actor, Tom Cruise. But if you ask my second question directly into a fresh session, it doesn't know the answer. Interestingly though, you can give it additional clues and it'll get it. https://chat.openai.com/share/893c1088-6718-4113-a3f1-cf273d1a23bc https://chat.openai.com/share/893c1088-6718-4113-a3f1-cf273d...
- alphablended 3y agoI misread lucubratory's comment: indeed I see the same as you do. I only tried asking both question in the same session. I didn't see that point in the paper when I quickly skimmed through it to find the relevant part. I also agree with him about humans capable of the same "errors".
- lucubratory 3y agoHer, but thank you for rereading the comment, I appreciate it.