5 ms·
If you ask people what the capitals of Turkey and Australia are, you might hear Istanbul and Sydney surprisingly often. There seems to be some probabilistic inf
by anfelor 5y ago
If you ask people what the capitals of Turkey and Australia are, you might hear Istanbul and Sydney surprisingly often. There seems to be some probabilistic inference in our brain that the largest city in a country should also be the capital.
- PeterisP 5y agoOn the other hand, if you ask the same person what the capital of Turkey is in a hundred different ways, you'll get the same answer (though possibly mistaken) at all times. They may have a wrong internal model of country capitals, but all language communication works with the same model; while a GPT-3 like model approaches each question with a separate probabilistic interference without attempting to "make up its mind" about some internally consistent "mental model", which is probably one of the key gaps that needs fixing to bring it up a level.