4 ms·
> Reason is the capacity of consciously applying logic by drawing conclusions from new or existing information, with the aim of seeking the truth. ChatGPT does
by m00x 4y ago
> Reason is the capacity of consciously applying logic by drawing conclusions from new or existing information, with the aim of seeking the truth.
ChatGPT doesn't care what word it puts in front of you, and if it's true or not. Reasoning must have a goal, and current LLMs don't. All it does it repeat what are the most common words that they've seen.
It also doesn't think. It's a completely forward process. It's definitely a part of human thinking, but not the reasoning part.
- randomdata 4y agoOne of the challenges faced by ChatGPT was in seeing it produce conversational-style output instead of simply the most common words that it saw. I'm not sure your definition really clears up how reasoning or thinking differ from "basic" statistical processes. Granted, perhaps it is not explainable. If it were we would understand it well enough to replicate it.
- m00x 4y ago> One of the challenges faced by ChatGPT was in seeing it produce conversational-style output instead of simply the most common words that it saw. Do you have a source for that? I've implemented GPT from scratch and I don't see anywhere that doesn't just take the current output + input as attention and produces the next word. The loss being if it correctly guessed what would be the next word according to context and position.
- randomdata 4y agoThere were some papers linked here yesterday. I'm not good at memorizing URLs. Sorry.
- fiso64 4y agoChatGPT was also trained with reinforcement learning to produce outputs human raters preferred
- m00x 4y agoIt's definitely getting closer in this case, but still chatGPT still look for any truth in its response.