3 ms·
> One core block is syntax, where meaningful units are combined into longer sequences, like words into sentences. I would think that syntax is a structure to t
by WalterBright 2y ago
> One core block is syntax, where meaningful units are combined into longer sequences, like words into sentences.
I would think that syntax is a structure to the sequence of symbols, not just a sequence in any order. For example:
Thag ate Fish
Fish ate Thag
have different meanings.
- HarHarVeryFunny 2y agoSyntax is hierarchical, and not as much sequential as you may think. LLMs are based on these two facts.
- somenameforme 2y agoI think your sentence would be much more accurate if you replace hierarchical with recursive.
- HarHarVeryFunny 2y agoTrue, at least conceptually (does brain actually do recursion?) - I was really thinking of linguist's hierarchical sentence parse trees, which are a nice visual representation of how different parts of sentence are syntactically unrelated and can therefore be processed in parallel, with levels of the "hierarchy" then corresponding to layers of the LLM.
- deleted 2y ago[deleted]