It appears to me that it is a big problem of the training set containing mostly questions that can be (and are) answered. Sure, on StackOverflow you will have q

It appears to me that it is a big problem of the training set containing mostly questions that can be (and are) answered. Sure, on StackOverflow you will have questions where the response is: please refine your question. But even then, did they use the raw input, or did they use the edited input? Similar with interviews: those are not actual interviews (for the most part) but edited for clarity. Hence, I doubt that GPT was much trained on reiterating questions and instead learned that there is always an answer, even if there is none to that particular question or when it does not know.