Here's my understanding of how GPT-4 works. Imagine you're a supercomputer and someone feeds you billions and billions and billions of pages of text written by

Here's my understanding of how GPT-4 works. Imagine you're a supercomputer and someone feeds you billions and billions and billions of pages of text written by humans. Then they ask you to compress it really really small. You can't compress it that small without figuring out a lot of the underlying laws, frameworks, and rules that apply to humans, that apply to the world, and so on. Compression == coming up with powerful frameworks that condense knowledge. It's kind of like how with a really powerful set of rules or frameworks in math or physics, you can derive many other things. As a side note, I suspect GPT-4 has inside its neurons a bunch of powerful frameworks about the world that humans haven't yet discovered.