Indeed, isn’t that the point? LLM training is designed to distill a massive corpus of facts, in the form of token sequences, into a much, much smaller bundle o

Indeed, isn’t that the point? LLM training is designed to distill a massive corpus of facts, in the form of token sequences, into a much, much smaller bundle of information that encodes (somehow!) the deep structure of those facts minus their particulars. They’re not search engines, they’re abstract pattern matchers.