3 ms·
They seem to do logical deduction when prompted to do so. What’s actually happening under the hood is so ass backward bizarre people jump to incorrect conclusi
by Retric 3y ago
They seem to do logical deduction when prompted to do so.
What’s actually happening under the hood is so ass backward bizarre people jump to incorrect conclusions. It’s amazing what you can do with that much data and computational power.
- dragonwriter 3y ago> They seem to do logical deduction when prompted to do so. Well, yes, narratives that look like reasoning and have accurate cobclusions are more common in their training data with langauge that references reasoning before them, so prompts that call for reasoning explicitly produce narration that looks like reasoning. (And which has more accurate conclusions, too.)
- lionkor 3y agoHow do you know that the question you ask it wasnt verbatim, or similar, in the training data, and that there is zero deduction going on?
- Retric 3y agoThat’s tricky because LLM’s can copy existing examples while plugging in different values. You can tell they aren’t actually using logic when they make long strings of extremely egregious mistakes, but when everything looks reasonable it’s very difficult to understand why it happened to be correct.