2 ms·

I dont actually see the point of using human-derived notions of 'language', 'syntax' , 'know', 'category' and even 'thinking' or 'parsing' when making precise

by seydor 4y ago

I dont actually see the point of using human-derived notions of 'language', 'syntax' , 'know', 'category' and even 'thinking' or 'parsing' when making precise arguments. Those are all vague, subjective notions that we made for ourselves but nature does not need to fit to our mold. The fact is, LLMs are the best quantitative model of the human communication code, so good that it can replicate it quite convincingly. Better than any model we had made before using our imprecise subjective notions, which were quite like alchemy. Whether it will prove to be 'thinking' or not, remains to be seen in the future. > the word "syntax" has no bearing on the model whatsoever, We don;t know that. One would have to look into the model weights for that and this analysis does not exist yet. If one can provide a decent definition of syntax, it may be found to reside somewhere in its weights. same for other subjective notions.

thomastjeffery 4y ago
> I dont actually see the point of using human-derived notions of...'thinking'... > Whether it will prove to be 'thinking' or not, remains to be seen in the future. Maybe you should take your own advice. You are really missing my point. Humans use language, syntax, thinking, etc. We know what those patterns are. LLMs do not. LLMs don't approach text with the same models that humans use: they model the text directly. Any pattern, whether it be a word or sentence or even a pattern that humans have no name for at all: the LLM models that pattern. What we humans call "syntax", "word", "idea", etc.; LLMs don't. They don't have any names for any things. They just have the collection of things in front of them, and implicitly model that collection. An LLM doesn't think objectively about its model, either. It only constructs continuations by modeling prompts. It is the content of the prompt itself that determines the continuation, not "thought".

by seydor 4y ago

thomastjeffery 4y ago

> I dont actually see the point of using human-derived notions of...'thinking'... > Whether it will prove to be 'thinking' or not, remains to be seen in the future. Maybe you should take your own advice. You are really missing my point. Humans use language, syntax, thinking, etc. We know what those patterns are. LLMs do not. LLMs don't approach text with the same models that humans use: they model the text directly. Any pattern, whether it be a word or sentence or even a pattern that humans have no name for at all: the LLM models that pattern. What we humans call "syntax", "word", "idea", etc.; LLMs don't. They don't have any names for any things. They just have the collection of things in front of them, and implicitly model that collection. An LLM doesn't think objectively about its model, either. It only constructs continuations by modeling prompts. It is the content of the prompt itself that determines the continuation, not "thought".