3 ms·
That's a philosophical issue, not technical. No one is saying these models are conscious or have human awareness of concepts. It mechanically builds a deeply
by xcv123 3y ago
That's a philosophical issue, not technical.
No one is saying these models are conscious or have human awareness of concepts.
It mechanically builds a deeply layered semantic model that correlates to our human understanding.
Quibbling over whether it is "real semantics" or not is just ironically quibbling over semantics. Yes its not conscious, but it doesn't need to be. It is possible to build a mechanical structure that correlates to a human understanding of the world and performs useful tasks that require only mechanical understanding and reasoning, without consciousness or emotions.
- somewhereoutth 3y agoThe distinction between semantics and syntax is pretty tight, no philosophy required. The former considers the domain being represented, whereas the latter is strictly the symbols used in the representation. So to be precise it mechanically builds a deeply layered syntactic model. LLMs just regurgitate syntax, any semantics can only be imagined by us and overlaid on the syntactic results produced.
- pmoriarty 3y agoDoes a definition of a word in a dictionary provide the syntax or the semantics of the word it defined?
- somewhereoutth 3y agoIn common use by humans, it provides semantics, in terms of other previously understood semantics. However, if there is no semantic understanding by the reader, then all it provides is a syntactic rewrite rule for each word.
- xcv123 3y agoYou are disagreeing philosophically about what constitutes "true" semantics. That is not a technical argument. If you are right about this, then you should edit or delete this wikipedia article and publish a paper to inform all NLP researchers that there is no such thing as a semantic similarity metric because NLP models cannot understand "true" semantics. https://en.wikipedia.org/wiki/Semantic_similarity https://en.wikipedia.org/wiki/Semantic_similarity