Think of it in terms of limited workspace memory. How much of a program can you really fit in your head at once? Both less and more than GPT, because humans ca

Think of it in terms of limited workspace memory. How much of a program can you really fit in your head at once? Both less and more than GPT, because humans can learn from limited input and also we have a lot of tricks for escaping our horribly limited context size. GPT probably has a larger context than humans, but it’s worse at everything else—to the degree that’s comparable. I wouldn’t bet on that changing soon. I also wouldn’t be on it staying the same.