2 ms·
> What types of limitations do you suppose? I don't see the capacity for LLMs to perform novel and creative reasoning tasks. They're limited by virtue of being
by n4r9 3y ago
> What types of limitations do you suppose?
I don't see the capacity for LLMs to perform novel and creative reasoning tasks. They're limited by virtue of being a pattern-matching system without the ability to make genuine causal or logical inferences.
I wrote here about my recent experiments with ChatGPT - https://news.ycombinator.com/item?id=37583333 https://news.ycombinator.com/item?id=37583333
I'm vaugely interested to know how GPT4 deals with questions like these, but I'm not willing to pay to find out.
- ilaksh 3y agoLol. So even the dumb version actually did your task, just not in a very convincing or "genuine" way. Pattern matching can be used for inference and GPT-4 does it very effectively. 3.5 turbo is relatively brittle and maybe 20 IQ points lower. But still, it did your task. Anyway, it will only be a year or two before things like tree search over problems spaces are explicitly integrated into models or systems similar to this. Deep Mind may have already done something like that.