4 ms·
> What this tells us for AI is that we need something else besides LLMs You mean besides a few layers of LLMs near input and output that deal with tokens? We h
by red75prime 2y ago
> What this tells us for AI is that we need something else besides LLMs
You mean besides a few layers of LLMs near input and output that deal with tokens? We have the rest of the layers.
- alephnerd 2y agoThose "few layers" sum up all of linguistics. 1. Syntax 2. Semantics 3. Pragmatics 4. Semiotics These are the layers you need to solve. Saussure already pointed out these issues over a century ago, and Linguists turned ML Researchers like Stuart Russell and Paul Smolensky tried in vain to resolve this. It basically took 60 years just to crack syntax at scale, and the other layers are still fairly far away. Furthermore, Syntax is not a solved problem yet in most languages. Try communicating with GPT-4o in colloquial Bhojpuri, Koshur, or Dogri, let alone much less represented languages and dialects.
- sojournerc 2y agoLinguistics is not living! Language does not capture reality! So no matter how much you solve you're no closer to AGI