4 ms·
The problem is that the training data doesn't contain a lot of "I don't know".
by amelius 1y ago
The problem is that the training data doesn't contain a lot of "I don't know".
- pegasus 1y agoThe bigger problem is that the benchmarks / multiple-choice tests they are trained to optimize for don't distinguish between a wrong answer and "I don't know". Which is stupid and surprising. There was a thread here on HN about this recently.
- astrange 1y agoThat's not important compared to the post-training RL, which isn't "training data".