2 ms·
> It's not clear they ever will be; It seems to me that the ability to reason ( though primitive it may still be) is an emergent property of sufficiently large
by throwawaymaths 3y ago
> It's not clear they ever will be;
It seems to me that the ability to reason ( though primitive it may still be) is an emergent property of sufficiently large differentiable hash/lookup tables (and if you think about the mechanism of reasoning, that seems... Reasonable).
According to "folks in the know", the scaling limits of GPT architecture seem to be nigh, but if it were a bit higher I wouldn't be surprised if LLMs would have made it.
- r-w 3y agoI think you’re conflating reasoning with inference. And in any case, GP wasn’t using reasoning, but rather resourcefulness/invention. I’m not sure an LLM can pull that off beyond coming up with vague, derivative fiction.
- throwawaymaths 3y agoGp said "state of being" so I don't think the either of us can know for sure what was meant by that.