Well, during training it got to see a great diversity of tasks, so it could form the meta-cognition bits. That's why it can adapt so fast to new demands. It doe

Well, during training it got to see a great diversity of tasks, so it could form the meta-cognition bits. That's why it can adapt so fast to new demands. It doesn't update it at inference time, true, but it is already baked in.