4 ms·
My sense has always been that, there actually is no difference between "the implicit meaning in text" and "correlations between sequential words". That is to s
by wavemode 2y ago
My sense has always been that, there actually is no difference between "the implicit meaning in text" and "correlations between sequential words".
That is to say, the fact that LLMs are able to communicate effectively with humans is a discovery about the regularity of the semantics of human communication, rather than a discovery about the intelligence of neural networks.
- naasking 2y agoAgreed: semantics boils down to a relational network between words that designate concepts, therefore large language models build a relational network of concepts. Meta just published large concept models which builds on this: https://ai.meta.com/research/publications/large-concept-models-language-modeling-in-a-sentence-representation-space/ https://ai.meta.com/research/publications/large-concept-mode...