3 ms·
I'm skeptical. We knew that the leaked prompts for ChatGPT were genuine because it was leaking the actual current date; putting in the current date was necessar
by gwern 4y ago
I'm skeptical. We knew that the leaked prompts for ChatGPT were genuine because it was leaking the actual current date; putting in the current date was necessary to stop it hallucinating about future events having already happened, but provided a highly reliable marker of prompt leaking - obviously, there's no way it could repeatedly hallucinate the actual current date without that being based on its prompt to some degree, and if it copied that part right repeatedly and reliably, then the rest is probably genuine too.
But in this case, the supposed current date in the last screenshot is 30 Oct 2022, which is nowhere close to 8 Feb 2023.
- btown 4y agoPerhaps if it was retrained on a corpus that included its own prompt, it might be hallucinating that a date in 2022 is what's most likely to come after it has regurgitated its prompt!
- metadat 4y agoIt's possible the work started in October 2022 and only became public knowledge in 2023. Shrug. Just sayin'. p.s. Gwern, your website is prolific. Thank you!
- lolinder 4y agoNo, because ostensibly that is the date for the current context, which should be sometime in February if not today.
- koolba 4y agoIs it that hard to believe that Microsoft hard coded the start date rather than making it dynamic?
- lolinder 4y agoWhat would the function of including a start date be if you don't give it the actual start date? The lazy thing to do would be to omit to the start date altogether, not hard code it.
- patapong 4y agoOne thing that also makes me hesitant is that the model is never informed concretely how it can search the internet. Presumably, you would require a specific syntax for it to launch a web search (such as [search:{query}]), but it is never informed of that syntax, just that it can search for things. Also: "While Sydney is helpful, it's actions are limited to the chat box." Ominous...
- layer8 4y agoThat last bit may be just to prevent it from hallucinating non-chatbox actions. Or in case someone tries to hook it up to a web API via its search capabilities.
- patapong 4y agoI didn't know people meant chatboxes when they were talking about the AI box experiment. ;)
- annoyingnoob 4y ago> "While Sydney is helpful, it's actions are limited to the chat box." Ominous... Its not Alexa.