5 ms·
What you call a huge opportunity is actually (or also, if you prefer) a major shortfall in the current LLMs. Whether it will turn out to be merely temporary, an
by mannykannot 4y ago
What you call a huge opportunity is actually (or also, if you prefer) a major shortfall in the current LLMs. Whether it will turn out to be merely temporary, and more pertinently, how it might be solved and whether it can be solved with more of the same, are themselves unanswered questions at this time.
- janalsncm 4y agoRight, it’s a fundamental disconnect between how an autoregressive statistical language model generates text and how people think about talking and writing. We have known this for a long time. It is the essence of the civil war between symbolic NLP folks and statistical language modeling folks. Now that ChatGPT is quasi-mainstream, the strengths and weaknesses of the latter are on display for all to see. My only point is that if we’re approaching a local maxima with purely statistical approaches, it raises the stakes for symbolic approaches to come through.