>So WTF couldn’t it just produce the correct code the first time? Probably for the same reason I can’t. We still know the gist of how they work and it's not li

>So WTF couldn’t it just produce the correct code the first time? Probably for the same reason I can’t. We still know the gist of how they work and it's not like you do, and you can see when they fail that they don't fail for the same reasons either I've seen GPT 3.5 fail to answer some questions correctly and subsequently (in another tab) get it right/choose not to answer if you just add the line "don't hallucinate" I like the article's idea for why that is >Presumably, "retrieving from memory" and "improvising an answer" are two different model behaviors, which use different internal mechanisms. Indeed, we can probe model inner layers and infer if it is "lying"1 or if "the question is unanswerable"2. These are very much related to "hallucinations".