3 ms·
I don't think LLM's are like (complete) human brains, I think they vaguely resemble what we mean by language "intuition". Brains need several other functions,
by trashtester 2y ago
I don't think LLM's are like (complete) human brains, I think they vaguely resemble what we mean by language "intuition".
Brains need several other functions, too. Including search, some kind of motivator or initiator and probably several layers of coordination/orchestration.
None of which need to be strictly separated from the other layers.
Adding some kind of Q search on top of LLM's means they're not just LLM's anymore, but a composite model that has an LLM as one component.
- ben_w 2y agoGenerally agree, but I would argue that while first L in LLM is what it is, the final LM is just what it does: a large model is still a "large language model" when it has other components besides a transformer involved in how it processes language, while a pure transformer model stops being a language model the moment it's trained on anything besides language — images (other than sign language), DNA sequences, financial data, etc.