3 ms·
People were already just asking ChatGPT. I don't believe there is any such fundamental limitation, especially when you look say two years down the road and don
by ilaksh 3y ago
People were already just asking ChatGPT.
I don't believe there is any such fundamental limitation, especially when you look say two years down the road and don't limit yourself to language-only models or the AI models of today. Already GPT-4 has audio and image input.
Good human programmers today have better abilities and more current knowledge overall than GPT-4. But it's a matter of degree, and a matter of time.
What types of limitations do you suppose? And again, we have to anticipate that these technologies evolve rapidly. LLM is a misleading term in my opinion for a fundamentally multimodal model. And totally new types of models or model integrations will be likely be coming out over the next few years that will make current systems obsolete. Such as combining AlphaZero-type systems with language models.
- n4r9 3y ago> What types of limitations do you suppose? I don't see the capacity for LLMs to perform novel and creative reasoning tasks. They're limited by virtue of being a pattern-matching system without the ability to make genuine causal or logical inferences. I wrote here about my recent experiments with ChatGPT - https://news.ycombinator.com/item?id=37583333 https://news.ycombinator.com/item?id=37583333 I'm vaugely interested to know how GPT4 deals with questions like these, but I'm not willing to pay to find out.
- ilaksh 3y agoLol. So even the dumb version actually did your task, just not in a very convincing or "genuine" way. Pattern matching can be used for inference and GPT-4 does it very effectively. 3.5 turbo is relatively brittle and maybe 20 IQ points lower. But still, it did your task. Anyway, it will only be a year or two before things like tree search over problems spaces are explicitly integrated into models or systems similar to this. Deep Mind may have already done something like that.