4 ms·
> It doesn't have a concept of facts, sentences or even concepts How different is that from humans I wonder? For example, when learning math we talk about deve
by merely-unlikely 4y ago
> It doesn't have a concept of facts, sentences or even concepts
How different is that from humans I wonder? For example, when learning math we talk about developing an intuition about a concept to help actually use it in daily life. This is separate from the rigor of the actual theory, but theory is harder to remember or fully internalize. Intuition to me is more of a feeling that something is related without necessarily really understanding what is going on.
- hooande 4y agoI'm sorry, but this point is trite and incorrect. Humans can manipulate concepts and compare them to other ideas. Which is why we're able to fact check and cite sources, where language models cannot. It's true that I'm just putting one word after another right now, like a language model. But I can combine those tokens into higher level abstractions like facts and ideas, which I can then compare with other facts and ideas. If ChatGPT could do this, it wouldn't be plausibly wrong nearly as often. Instead it's just "what word is statistically likely to come next?"