2 ms·
We aren't testing whether the model's results are stable or correct for a given class of problem. The goal is to establish whether the model can reason. Nothin
by zahlman 2y ago
We aren't testing whether the model's results are stable or correct for a given class of problem. The goal is to establish whether the model can reason.
Nothing capable of reasoning would contradict itself so blatantly and in such a short span while failing to indicate any kind of uncertainty.
- Isinlor 2y agoReasoning is not a binary skill. And failure modes of other types of reasoners do not need to be the same as the failure modes of humans.