4 ms·
I'm referring to the statistical power of the model. For example, if you replace GPT4 with GPT2 it will lose every game, because the statistical power is lower.
by root_axis 4y ago
I'm referring to the statistical power of the model. For example, if you replace GPT4 with GPT2 it will lose every game, because the statistical power is lower. Increasing the statistical power doesn't make the model understand any better, it just makes it more likely to generate a response that aligns with human expectations.
- chpatrick 4y ago"Statistical power" isn't some magic property of GPT4. It can produce statistically more likely moves because somewhere deep down it can model chess.
- root_axis 4y agoIt isn't a model of chess, it's a model of internet text, if it was a model of chess it wouldn't make illegal moves.
- bsaul 4y agoif it didn't have at least some kind of model of chess, it wouldn't be able to play past midgame. Simply because on a new position, moves from other positions aren't applicable at all.