LLMs don't derive or follow rules. LLMs don't have anything to do with rules. They implicitly recognize (and model) patterns in text, then continue those patte

LLMs don't derive or follow rules. LLMs don't have anything to do with rules. They implicitly recognize (and model) patterns in text, then continue those patterns. While the patterns that an LLM has modeled may align to the high abstraction we call language, LLMs actually work at a much lower level of abstraction: plain text. It's the content of that text that is significant. We encode language into text, and LLMs infer something "close enough" to language by blindly modeling it.