It will learn. It's called "in-context learning". This learning will be limited to the current context window, because it won't get encoded in the model paramet

It will learn. It's called "in-context learning". This learning will be limited to the current context window, because it won't get encoded in the model parameters. In order to make it permanent, you would need to retrain/finetune the model using the new information.