2 ms·
I don’t think we’ve seen any evidence of experimentation in these models, it is in fact the key component they are missing
by mountainriver 4y ago
I don’t think we’ve seen any evidence of experimentation in these models, it is in fact the key component they are missing
- naasking 4y agoSure, but my point is simply that evidence of mistakes does not necessarily entail a lack of an accurate world model. When underlying models can only be inferred, there can never be 100% certainty that any inferred model is truly accurate, even when it is. Humans are only certain of Othello's rules because we have direct access to those rules. If you put a human being in GPT's place in this exact same scenario, they too would make comparable mistakes. Humans are clearly capable of world models, therefore those mistakes are not an indication that world models are not in use.