On the other hand, if you ask the same person what the capital of Turkey is in a hundred different ways, you'll get the same answer (though possibly mistaken) a

On the other hand, if you ask the same person what the capital of Turkey is in a hundred different ways, you'll get the same answer (though possibly mistaken) at all times. They may have a wrong internal model of country capitals, but all language communication works with the same model; while a GPT-3 like model approaches each question with a separate probabilistic interference without attempting to "make up its mind" about some internally consistent "mental model", which is probably one of the key gaps that needs fixing to bring it up a level.