> We still don't understand how these models really work, at least not in a way that teaches us anything about language or about humanity. We understand how LL

> We still don't understand how these models really work, at least not in a way that teaches us anything about language or about humanity. We understand how LLMs work conceptually. Human language, when parameterized as a sequence of tokens, has geometry and structure in a billion dimensional space. A priori, we didn't know that. So in a very real sense, a discovery was made.