18 ms·
The Chomsky hierarchy is a classification of grammars. So it's about Syntax. GPT is purely about semantics, about truth. To the extent that I think it can be s
by enriquepablo 10mo ago
The Chomsky hierarchy is a classification of grammars. So it's about Syntax.
GPT is purely about semantics, about truth. To the extent that I think it can be said to be fundamentally informal in its dedication to truth, since it can easily be prompted to produce syntactically incorrect output - wrt the syntax of whatever language whose semantics determine the truth GPT is asked to reflect.
So I think this is a categorically incorrect question.
I mean, what is the fundamental syntax of the output of an LLM? It would have to be that any sequence of utf8 chars is valid.
- suddenlybananas 10mo agoLLMs have absolutely nothing to do with truth. If anything the analogy is closer to syntax as LLMs are pure form, just language in absence of any context or reference.
- enriquepablo 10mo agoLLMs tell you one thing and not its negation, this choice is semantic. "just language in absence of any context or reference" is a set that includes every valid text. The usefulness of LLMs is their ability to mostly respect whatever semantics you establish in the prompt in their choice of output.
- suddenlybananas 10mo agoLLMs will definitely tell you a thing and its negation if you prompt them differently.
- ursAxZA 10mo agoIsn’t it just symbols in, symbols out? We have hardware that can process long symbol sequences very fast — that’s basically it.