4 ms·
There's definitely some people out there that think LLMs reason the same way we do and understand things the same way, and 'know' what paint is and what a wall
by simonh 3y ago
There's definitely some people out there that think LLMs reason the same way we do and understand things the same way, and 'know' what paint is and what a wall is. That's clearly not true. However it does understand the linguistic relationship between them, and a lot of other things, and can reason about those relationships in some very interesting ways. So yes absolutely, details matter.
It's a complex and tricky issue, and everyday language is vague and easy to interpret in different ways, so it can take a wile to hash these things out.
- junofan 3y agoOpenAI probably loaded up the training set with logic puzzles. Great marketing.
- hutzlibu 3y agoSure thing, they also adress this in the paper. https://cdn.openai.com/papers/gpt-4.pdf https://cdn.openai.com/papers/gpt-4.pdf Still, it is great marketing, because it is impressive.
- simonh 3y agoSince it genuinely seems to have generalised those logical principles and can apply them to novel questions, I’d say it’s more than just marketing.
- hutzlibu 3y ago"It's a complex and tricky issue, and everyday language is vague and easy to interpret in different ways, so it can take a wile to hash these things out." Yes, in another context I would say, ChatGPT can better reason, than many people, since it scored very high on the SAT tests, making it formally smarter, than most humans.