3 ms·
The answer is quite simple: It’s not in the training data. These models don’t think.
by grey-area 9mo ago
The answer is quite simple:
It’s not in the training data.
These models don’t think.
- GeoAtreides 9mo agono, no, in this case, that's the thing, it is in the training data just heavily (heavily!) biased towards walking
- grey-area 9mo agoThis particular situation is not in the training data, though I’m sure it will be soon to try to shore up claims of ‘reasoning’.
- jason_oster 8mo agoThe goal of training data is not to collect and reproduce facts. It is to align the model with the statistical probability of producing the correct (expected) response for data outside of its knowledge domain. This is called generalization [1], and it has been explored in depth. [1]: https://arxiv.org/abs/2312.17173 https://arxiv.org/abs/2312.17173