4 ms·
How do you know that the question you ask it wasnt verbatim, or similar, in the training data, and that there is zero deduction going on?
by lionkor 3y ago
How do you know that the question you ask it wasnt verbatim, or similar, in the training data, and that there is zero deduction going on?
- Retric 3y agoThat’s tricky because LLM’s can copy existing examples while plugging in different values. You can tell they aren’t actually using logic when they make long strings of extremely egregious mistakes, but when everything looks reasonable it’s very difficult to understand why it happened to be correct.