It is not very surprising that this kind of obscure knowledge is not handled nicely, since the data points are very sparse. The issue here is not ChatGPT's gen

It is not very surprising that this kind of obscure knowledge is not handled nicely, since the data points are very sparse. The issue here is not ChatGPT's general usefulness, but it usually don't say "Sorry, I'm not sure" since it currently lacks of ability to evaluate confidence of its own answer based on the real world data. If we think the model is an efficient-but-lossy compression on the real world, then it currently lacks of a good way to error detection. If we want more general intelligence, it should have a way to measure consistency between the input (or its understanding on real world) and potential model output and its confidence interval. This is what we do everyday as a human to make a decision. I guess we probably need a number of more breakthroughs to overcome this weakness. Error correction would be the next step, and a much harder problem.