3 ms·
I agree with your sentiment, and for some time now I fear that all this hype will lead to another AI winter. Large language models are a true breakthrough and
by telmo 4y ago
I agree with your sentiment, and for some time now I fear that all this hype will lead to another AI winter.
Large language models are a true breakthrough and they are, in my view, much more useful than ChatGPT. They allow for some fundamental NLP tasks that can then be used as building blocks for truly intelligent systems.
Symbolic AI failed because it could not deal with complexity and fuzziness. Statistical learning can deal with complexity and fuzziness, but it is very limited when it comes to rigorous reasoning.
I believe that true AI will combine both ideas, and I have a strong hunch that neurosymbolic approaches will be crucial, but nobody really knows yet how to create a true neurosymbolic approach that seamlessly combines the strengths of symbolic and statistical approaches. My fear is that we throw the baby out with the bath water when people are finally fed up with ChatGPT hype, and then we will have to wait a couple decades before the next serious attempt at AI is made.
- gallopingcomp 4y agoAbsolutely agreeing that true “intelligence” would come from such a synthesis - it also loosely matches what we know from cognitive psychology. We won’t go anywhere without rigorously addressing knowledge representation and reasoning - unlike humans, language is the only faculty ChatGPT possesses (and the power of language has been oversold for a while). The cynic in me would rather have the backlash (and a rude awakening for the industry), than the looming hyper-normalization of convincing-sounding bullshit/plagiarism/etc (and new, more convoluted forms of “saying the magic words to make the algorithm behave”) in the near future. (Relatedly: Say what you will about the rationalist community, they appear to have really thought about a lot of this.)